Nov 07 15:16:13 user nova-compute[75018]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75018) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75018) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75018) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 07 15:16:13 user nova-compute[75018]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.017s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:16:13 user nova-compute[75018]: INFO nova.virt.driver [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 07 15:16:13 user nova-compute[75018]: INFO nova.compute.provider_config [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] Acquiring lock "singleton_lock" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] Acquired lock "singleton_lock" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] Releasing lock "singleton_lock" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] Full set of CONF: {{(pid=75018) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ******************************************************************************** {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] Configuration options gathered from: {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ================================================================================ {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] allow_resize_to_same_host      = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] arq_binding_timeout            = 300 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] backdoor_port                  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] backdoor_socket                = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] block_device_allocate_retries  = 300 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] block_device_allocate_retries_interval = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cert                           = self.pem {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] compute_monitors               = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] config_dir                     = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] config_drive_format            = iso9660 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] config_source                  = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] console_host                   = user {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] control_exchange               = nova {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cpu_allocation_ratio           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] daemon                         = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] debug                          = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] default_access_ip_network_name = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] default_availability_zone      = nova {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] default_ephemeral_format       = ext4 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] default_green_pool_size        = 1000 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] default_schedule_zone          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] disk_allocation_ratio          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] enable_new_services            = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] enabled_ssl_apis               = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] flat_injected                  = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] force_config_drive             = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] force_raw_images               = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] graceful_shutdown_timeout      = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] heal_instance_info_cache_interval = 60 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] host                           = user {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] instance_build_timeout         = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] instance_delete_interval       = 300 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] instance_name_template         = instance-%08x {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] instance_usage_audit           = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] instance_usage_audit_period    = month {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] internal_service_availability_zone = internal {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] key                            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] live_migration_retry_count     = 30 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] log_config_append              = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] log_dir                        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] log_file                       = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] log_options                    = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] log_rotate_interval            = 1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] log_rotate_interval_type       = days {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] log_rotation_type              = none {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] long_rpc_timeout               = 1800 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] max_concurrent_builds          = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] max_concurrent_live_migrations = 1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] max_concurrent_snapshots       = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] max_local_block_devices        = 3 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] max_logfile_count              = 30 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] max_logfile_size_mb            = 200 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] maximum_instance_delete_attempts = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] metadata_listen                = 0.0.0.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] metadata_listen_port           = 8775 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] metadata_workers               = 3 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] migrate_max_retries            = -1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] mkisofs_cmd                    = genisoimage {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] my_ip                          = 10.0.0.210 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] network_allocate_retries       = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] osapi_compute_listen_port      = 8774 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] osapi_compute_unique_server_name_scope =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] osapi_compute_workers          = 3 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] password_length                = 12 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] periodic_enable                = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] periodic_fuzzy_delay           = 60 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] pointer_model                  = ps2mouse {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] preallocate_images             = none {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] publish_errors                 = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] pybasedir                      = /opt/stack/nova {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ram_allocation_ratio           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] rate_limit_burst               = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] rate_limit_except_level        = CRITICAL {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] rate_limit_interval            = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] reboot_timeout                 = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] reclaim_instance_interval      = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] record                         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] reimage_timeout_per_gb         = 60 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] report_interval                = 120 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] rescue_timeout                 = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] reserved_host_cpus             = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] reserved_host_disk_mb          = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] reserved_host_memory_mb        = 512 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] reserved_huge_pages            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] resize_confirm_window          = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] resize_fs_using_block_device   = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] resume_guests_state_on_host_boot = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] rpc_response_timeout           = 60 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] run_external_periodic_tasks    = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] running_deleted_instance_action = reap {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] running_deleted_instance_timeout = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] scheduler_instance_sync_interval = 120 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] service_down_time              = 720 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] servicegroup_driver            = db {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] shelved_offload_time           = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] shelved_poll_interval          = 3600 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] shutdown_timeout               = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] source_is_ipv6                 = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ssl_only                       = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] state_path                     = /opt/stack/data/nova {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] sync_power_state_interval      = 600 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] sync_power_state_pool_size     = 1000 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] syslog_log_facility            = LOG_USER {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] tempdir                        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] timeout_nbd                    = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] transport_url                  = **** {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] update_resources_interval      = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] use_cow_images                 = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] use_eventlog                   = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] use_journal                    = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] use_json                       = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] use_rootwrap_daemon            = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] use_stderr                     = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] use_syslog                     = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vcpu_pin_set                   = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vif_plugging_is_fatal          = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vif_plugging_timeout           = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] virt_mkfs                      = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] volume_usage_poll_interval     = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] watch_log_file                 = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] web                            = /usr/share/spice-html5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_concurrency.disable_process_locking = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.auth_strategy              = keystone {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.compute_link_prefix        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.dhcp_domain                = novalocal {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.enable_instance_password   = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.glance_link_prefix         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.instance_list_per_project_cells = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.list_records_by_skipping_down_cells = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.local_metadata_per_cell    = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.max_limit                  = 1000 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.metadata_cache_expiration  = 15 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.neutron_default_tenant_id  = default {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.use_forwarded_for          = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.use_neutron_default_nets   = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.vendordata_dynamic_targets = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.vendordata_jsonfile_path   = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.backend_argument         = **** {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.config_prefix            = cache.oslo {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.dead_timeout             = 60.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.debug_cache_backend      = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.enable_retry_client      = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.enable_socket_keepalive  = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.enabled                  = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.expiration_time          = 600 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.hashclient_retry_attempts = 2 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.memcache_dead_retry      = 300 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.memcache_password        =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.memcache_sasl_enabled    = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.memcache_username        =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.proxies                  = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.retry_attempts           = 2 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.retry_delay              = 0.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.socket_keepalive_count   = 1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.socket_keepalive_idle    = 1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.socket_keepalive_interval = 1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.tls_allowed_ciphers      = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.tls_cafile               = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.tls_certfile             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.tls_enabled              = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cache.tls_keyfile              = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.auth_section            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.auth_type               = password {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.cafile                  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.certfile                = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.collect_timing          = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.cross_az_attach         = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.debug                   = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.endpoint_template       = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.http_retries            = 3 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.insecure                = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.keyfile                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.os_region_name          = RegionOne {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.split_loggers           = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cinder.timeout                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] compute.cpu_dedicated_set      = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] compute.cpu_shared_set         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] compute.image_type_exclude_list = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] compute.resource_provider_association_refresh = 300 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] compute.shutdown_retry_interval = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] conductor.workers              = 3 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] console.allowed_origins        = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] console.ssl_ciphers            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] console.ssl_minimum_version    = default {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] consoleauth.token_ttl          = 600 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.cafile                  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.certfile                = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.collect_timing          = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.connect_retries         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.connect_retry_delay     = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.endpoint_override       = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.insecure                = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.keyfile                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.max_version             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.min_version             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.region_name             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.service_name            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.service_type            = accelerator {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.split_loggers           = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.status_code_retries     = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.status_code_retry_delay = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.timeout                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] cyborg.version                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.backend               = sqlalchemy {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.connection            = **** {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.connection_debug      = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.connection_parameters =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.connection_recycle_time = 3600 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.connection_trace      = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.db_inc_retry_interval = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.db_max_retries        = 20 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.db_max_retry_interval = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.db_retry_interval     = 1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.max_overflow          = 50 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.max_pool_size         = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.max_retries           = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.mysql_wsrep_sync_wait = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.pool_timeout          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.retry_interval        = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.slave_connection      = **** {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] database.sqlite_synchronous    = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.backend           = sqlalchemy {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.connection        = **** {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.connection_debug  = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.connection_parameters =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.connection_recycle_time = 3600 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.connection_trace  = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.db_inc_retry_interval = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.db_max_retries    = 20 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.db_max_retry_interval = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.db_retry_interval = 1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.max_overflow      = 50 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.max_pool_size     = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.max_retries       = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.pool_timeout      = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.retry_interval    = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.slave_connection  = **** {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] api_database.sqlite_synchronous = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] devices.enabled_mdev_types     = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ephemeral_storage_encryption.enabled = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.api_servers             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.cafile                  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.certfile                = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.collect_timing          = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.connect_retries         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.connect_retry_delay     = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.debug                   = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.default_trusted_certificate_ids = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.enable_certificate_validation = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.enable_rbd_download     = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:13 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.endpoint_override       = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.insecure                = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.keyfile                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.max_version             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.min_version             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.num_retries             = 3 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.rbd_ceph_conf           =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.rbd_connect_timeout     = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.rbd_pool                =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.rbd_user                =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.region_name             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.service_name            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.service_type            = image {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.split_loggers           = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.status_code_retries     = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.status_code_retry_delay = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.timeout                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.verify_glance_signatures = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] glance.version                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] guestfs.debug                  = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.config_drive_cdrom      = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.config_drive_inject_password = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.enable_remotefx         = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.instances_path_share    =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.limit_cpu_features      = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.use_multipath_io        = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.vswitch_name            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] mks.enabled                    = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] image_cache.manager_interval   = 2400 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] image_cache.precache_concurrency = 1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] image_cache.remove_unused_base_images = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] image_cache.subdirectory_name  = _base {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.api_max_retries         = 60 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.api_retry_interval      = 2 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.auth_section            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.auth_type               = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.cafile                  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.certfile                = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.collect_timing          = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.conductor_group         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.connect_retries         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.connect_retry_delay     = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.endpoint_override       = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.insecure                = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.keyfile                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.max_version             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.min_version             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.peer_list               = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.region_name             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.serial_console_state_timeout = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.service_name            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.service_type            = baremetal {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.split_loggers           = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.status_code_retries     = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.status_code_retry_delay = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.timeout                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ironic.version                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] key_manager.fixed_key          = **** {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.barbican_api_version  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.barbican_endpoint     = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.barbican_endpoint_type = public {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.barbican_region_name  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.cafile                = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.certfile              = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.collect_timing        = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.insecure              = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.keyfile               = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.number_of_retries     = 60 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.retry_delay           = 1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.send_service_user_token = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.split_loggers         = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.timeout               = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.verify_ssl            = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican.verify_ssl_path       = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican_service_user.auth_section = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican_service_user.auth_type = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican_service_user.cafile   = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican_service_user.certfile = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican_service_user.collect_timing = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican_service_user.insecure = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican_service_user.keyfile  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican_service_user.split_loggers = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] barbican_service_user.timeout  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.approle_role_id          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.approle_secret_id        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.cafile                   = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.certfile                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.collect_timing           = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.insecure                 = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.keyfile                  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.kv_mountpoint            = secret {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.kv_path                  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.kv_version               = 2 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.namespace                = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.root_token_id            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.split_loggers            = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.ssl_ca_crt_file          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.timeout                  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.use_ssl                  = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.auth_section          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.auth_type             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.cafile                = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.certfile              = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.collect_timing        = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.connect_retries       = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.connect_retry_delay   = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.endpoint_override     = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.insecure              = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.keyfile               = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.max_version           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.min_version           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.region_name           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.service_name          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.service_type          = identity {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.split_loggers         = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.status_code_retries   = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.status_code_retry_delay = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.timeout               = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] keystone.version               = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.connection_uri         =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.cpu_mode               = custom {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: WARNING oslo_config.cfg [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.cpu_power_governor_high = performance {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.cpu_power_management   = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.device_detach_attempts = 8 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.device_detach_timeout  = 20 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.disk_cachemodes        = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.disk_prefix            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.enabled_perf_events    = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.file_backed_memory     = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.gid_maps               = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.hw_disk_discard        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.hw_machine_type        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.images_rbd_pool        = rbd {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.images_type            = default {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.images_volume_group    = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.inject_key             = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.inject_partition       = -2 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.inject_password        = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.iscsi_iface            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.iser_use_multipath     = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.live_migration_downtime = 500 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.live_migration_inbound_addr = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.live_migration_scheme  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.live_migration_timeout_action = abort {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.live_migration_tunnelled = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: WARNING oslo_config.cfg [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 07 15:16:14 user nova-compute[75018]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 07 15:16:14 user nova-compute[75018]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 07 15:16:14 user nova-compute[75018]: and ``live_migration_inbound_addr`` respectively.
Nov 07 15:16:14 user nova-compute[75018]: ).  Its value may be silently ignored in the future.
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.live_migration_with_native_tls = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.max_queues             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.nfs_mount_options      = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.num_pcie_ports         = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.pmem_namespaces        = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.quobyte_client_cfg     = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.rbd_secret_uuid        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.rbd_user               = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.rescue_image_id        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.rescue_kernel_id       = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.rx_queue_size          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.smbfs_mount_options    =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.snapshot_compression   = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.snapshot_image_format  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.sparse_logical_volumes = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.swtpm_enabled          = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.swtpm_group            = tss {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.swtpm_user             = tss {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.sysinfo_serial         = unique {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.tb_cache_size          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.tx_queue_size          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.uid_maps               = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.use_virtio_for_bridges = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.virt_type              = kvm {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.volume_clear           = zero {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.volume_clear_size      = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.volume_use_multipath   = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.vzstorage_cache_path   = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.auth_section           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.auth_type              = password {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.cafile                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.certfile               = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.collect_timing         = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.connect_retries        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.connect_retry_delay    = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.default_floating_pool  = public {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.endpoint_override      = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.extension_sync_interval = 600 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.http_retries           = 3 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.insecure               = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.keyfile                = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.max_version            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.min_version            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.ovs_bridge             = br-int {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.physnets               = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.region_name            = RegionOne {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.service_metadata_proxy = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.service_name           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.service_type           = network {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.split_loggers          = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.status_code_retries    = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.status_code_retry_delay = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.timeout                = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] neutron.version                = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] notifications.bdms_in_notifications = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] notifications.default_level    = INFO {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] notifications.notification_format = unversioned {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] notifications.notify_on_state_change = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] pci.alias                      = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] pci.device_spec                = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] pci.report_in_placement        = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.auth_section         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.auth_type            = password {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.cafile               = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.certfile             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.collect_timing       = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.connect_retries      = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.connect_retry_delay  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.default_domain_id    = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.default_domain_name  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.domain_id            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.domain_name          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.endpoint_override    = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.insecure             = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.keyfile              = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.max_version          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.min_version          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.password             = **** {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.project_domain_id    = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.project_domain_name  = Default {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.project_id           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.project_name         = service {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.region_name          = RegionOne {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.service_name         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.service_type         = placement {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.split_loggers        = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.status_code_retries  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.status_code_retry_delay = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.system_scope         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.timeout              = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.trust_id             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.user_domain_id       = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.user_domain_name     = Default {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.user_id              = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.username             = placement {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] placement.version              = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] quota.cores                    = 20 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] quota.count_usage_from_placement = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] quota.injected_file_content_bytes = 10240 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] quota.injected_file_path_length = 255 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] quota.injected_files           = 5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] quota.instances                = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] quota.key_pairs                = 100 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] quota.metadata_items           = 128 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] quota.ram                      = 51200 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] quota.recheck_quota            = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] quota.server_group_members     = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] quota.server_groups            = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] rdp.enabled                    = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] scheduler.image_metadata_prefilter = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] scheduler.max_attempts         = 3 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] scheduler.max_placement_results = 1000 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] scheduler.workers              = 3 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.host_subset_size = 1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.isolated_hosts = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.isolated_images = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.pci_in_placement = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.track_instance_changes = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] metrics.required               = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] metrics.weight_multiplier      = 1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] metrics.weight_setting         = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] serial_console.enabled         = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] serial_console.port_range      = 10000:20000 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] serial_console.serialproxy_port = 6083 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] service_user.auth_section      = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] service_user.auth_type         = password {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] service_user.cafile            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] service_user.certfile          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] service_user.collect_timing    = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] service_user.insecure          = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] service_user.keyfile           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] service_user.send_service_user_token = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] service_user.split_loggers     = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] service_user.timeout           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] spice.agent_enabled            = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] spice.enabled                  = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] spice.html5proxy_port          = 6082 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] spice.image_compression        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] spice.jpeg_compression         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] spice.playback_compression     = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] spice.server_listen            = 127.0.0.1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] spice.streaming_mode           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] spice.zlib_compression         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] upgrade_levels.baseapi         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] upgrade_levels.cert            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] upgrade_levels.compute         = auto {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] upgrade_levels.conductor       = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] upgrade_levels.scheduler       = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vendordata_dynamic_auth.cafile = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vendordata_dynamic_auth.certfile = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vendordata_dynamic_auth.insecure = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vendordata_dynamic_auth.timeout = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.api_retry_count         = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.ca_file                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.cache_prefix            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.cluster_name            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.connection_pool_size    = 10 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.console_delay_seconds   = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.datastore_regex         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.host_ip                 = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.host_password           = **** {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.host_port               = 443 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.host_username           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.insecure                = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.integration_bridge      = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.maximum_objects         = 100 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.pbm_default_policy      = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.pbm_enabled             = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.pbm_wsdl_location       = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.serial_port_proxy_uri   = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.serial_port_service_uri = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.task_poll_interval      = 0.5 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.use_linked_clone        = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.vnc_keymap              = en-us {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.vnc_port                = 5900 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vmware.vnc_port_total          = 10000 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vnc.auth_schemes               = ['none'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vnc.enabled                    = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vnc.novncproxy_port            = 6080 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vnc.vencrypt_ca_certs          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vnc.vencrypt_client_cert       = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vnc.vencrypt_client_key        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.disable_rootwrap   = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.enable_numa_live_migration = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.libvirt_disable_apic = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] wsgi.client_socket_timeout     = 900 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] wsgi.default_pool_size         = 1000 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] wsgi.keep_alive                = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] wsgi.max_header_line           = 16384 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] wsgi.ssl_ca_file               = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] wsgi.ssl_cert_file             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] wsgi.ssl_key_file              = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] wsgi.tcp_keepidle              = 600 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] zvm.ca_file                    = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] zvm.cloud_connector_url        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] zvm.reachable_timeout          = 300 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_policy.enforce_new_defaults = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_policy.enforce_scope      = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_policy.policy_default_rule = default {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] profiler.connection_string     = messaging:// {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] profiler.enabled               = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] profiler.es_doc_type           = notification {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] profiler.es_scroll_size        = 10000 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] profiler.es_scroll_time        = 2m {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] profiler.filter_error_trace    = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] profiler.hmac_keys             = **** {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] profiler.sentinel_service_name = mymaster {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] profiler.socket_timeout        = 0.1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] profiler.trace_requests        = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] profiler.trace_sqlalchemy      = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] profiler_jaeger.process_tags   = {} {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] profiler_jaeger.service_name_prefix = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] profiler_otlp.service_name_prefix = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] remote_debug.host              = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] remote_debug.port              = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_notifications.retry = -1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.auth_section        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.auth_type           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.cafile              = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.certfile            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.collect_timing      = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.connect_retries     = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.connect_retry_delay = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.endpoint_id         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.endpoint_override   = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.insecure            = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.keyfile             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.max_version         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.min_version         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.region_name         = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.service_name        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.service_type        = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.split_loggers       = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.status_code_retries = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.status_code_retry_delay = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.timeout             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.valid_interfaces    = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_limit.version             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_reports.file_event_handler = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] oslo_reports.log_dir           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vif_plug_ovs_privileged.group  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] vif_plug_ovs_privileged.user   = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_ovs.isolate_vif         = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] os_brick.lock_path             = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] privsep_osbrick.capabilities   = [21] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] privsep_osbrick.group          = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] privsep_osbrick.helper_command = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] privsep_osbrick.user           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] nova_sys_admin.group           = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] nova_sys_admin.helper_command  = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] nova_sys_admin.user            = None {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG oslo_service.service [None req-7ba32fd8-ac9d-4d79-85b8-26698f3f74e3 None None] ******************************************************************************** {{(pid=75018) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 07 15:16:14 user nova-compute[75018]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 07 15:16:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Connecting to libvirt: qemu:///system {{(pid=75018) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7feb01842fb0> {{(pid=75018) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 07 15:16:14 user nova-compute[75018]: libvirt:  error : internal error: could not initialize domain event timer
Nov 07 15:16:14 user nova-compute[75018]: WARNING nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 07 15:16:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7feb01842fb0> {{(pid=75018) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Starting native event thread {{(pid=75018) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Starting green dispatch thread {{(pid=75018) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 07 15:16:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Starting connection event dispatch thread {{(pid=75018) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 07 15:16:14 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Connection event '1' reason 'None'
Nov 07 15:16:14 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 07 15:16:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.mount [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Initialising _HostMountState generation 0 {{(pid=75018) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 07 15:16:21 user nova-compute[75018]: INFO nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Libvirt host capabilities <capabilities>
Nov 07 15:16:21 user nova-compute[75018]:   <host>
Nov 07 15:16:21 user nova-compute[75018]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 07 15:16:21 user nova-compute[75018]:     <cpu>
Nov 07 15:16:21 user nova-compute[75018]:       <arch>x86_64</arch>
Nov 07 15:16:21 user nova-compute[75018]:       <model>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <vendor>Intel</vendor>
Nov 07 15:16:21 user nova-compute[75018]:       <microcode version='1070'/>
Nov 07 15:16:21 user nova-compute[75018]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 07 15:16:21 user nova-compute[75018]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature name='ss'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature name='vmx'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature name='pcid'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature name='osxsave'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature name='hypervisor'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature name='arat'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature name='tsc_adjust'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature name='md-clear'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature name='stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature name='arch-capabilities'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature name='ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature name='invtsc'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature name='rsba'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature name='skip-l1dfl-vmentry'/>
Nov 07 15:16:21 user nova-compute[75018]:       <pages unit='KiB' size='4'/>
Nov 07 15:16:21 user nova-compute[75018]:       <pages unit='KiB' size='2048'/>
Nov 07 15:16:21 user nova-compute[75018]:     </cpu>
Nov 07 15:16:21 user nova-compute[75018]:     <power_management>
Nov 07 15:16:21 user nova-compute[75018]:       <suspend_mem/>
Nov 07 15:16:21 user nova-compute[75018]:       <suspend_disk/>
Nov 07 15:16:21 user nova-compute[75018]:       <suspend_hybrid/>
Nov 07 15:16:21 user nova-compute[75018]:     </power_management>
Nov 07 15:16:21 user nova-compute[75018]:     <iommu support='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     <migration_features>
Nov 07 15:16:21 user nova-compute[75018]:       <live/>
Nov 07 15:16:21 user nova-compute[75018]:       <uri_transports>
Nov 07 15:16:21 user nova-compute[75018]:         <uri_transport>tcp</uri_transport>
Nov 07 15:16:21 user nova-compute[75018]:         <uri_transport>rdma</uri_transport>
Nov 07 15:16:21 user nova-compute[75018]:       </uri_transports>
Nov 07 15:16:21 user nova-compute[75018]:     </migration_features>
Nov 07 15:16:21 user nova-compute[75018]:     <topology>
Nov 07 15:16:21 user nova-compute[75018]:       <cells num='2'>
Nov 07 15:16:21 user nova-compute[75018]:         <cell id='0'>
Nov 07 15:16:21 user nova-compute[75018]:           <memory unit='KiB'>8140616</memory>
Nov 07 15:16:21 user nova-compute[75018]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 07 15:16:21 user nova-compute[75018]:           <pages unit='KiB' size='2048'>0</pages>
Nov 07 15:16:21 user nova-compute[75018]:           <distances>
Nov 07 15:16:21 user nova-compute[75018]:             <sibling id='0' value='10'/>
Nov 07 15:16:21 user nova-compute[75018]:             <sibling id='1' value='20'/>
Nov 07 15:16:21 user nova-compute[75018]:           </distances>
Nov 07 15:16:21 user nova-compute[75018]:           <cpus num='6'>
Nov 07 15:16:21 user nova-compute[75018]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 07 15:16:21 user nova-compute[75018]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 07 15:16:21 user nova-compute[75018]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 07 15:16:21 user nova-compute[75018]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 07 15:16:21 user nova-compute[75018]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 07 15:16:21 user nova-compute[75018]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 07 15:16:21 user nova-compute[75018]:           </cpus>
Nov 07 15:16:21 user nova-compute[75018]:         </cell>
Nov 07 15:16:21 user nova-compute[75018]:         <cell id='1'>
Nov 07 15:16:21 user nova-compute[75018]:           <memory unit='KiB'>8255100</memory>
Nov 07 15:16:21 user nova-compute[75018]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 07 15:16:21 user nova-compute[75018]:           <pages unit='KiB' size='2048'>0</pages>
Nov 07 15:16:21 user nova-compute[75018]:           <distances>
Nov 07 15:16:21 user nova-compute[75018]:             <sibling id='0' value='20'/>
Nov 07 15:16:21 user nova-compute[75018]:             <sibling id='1' value='10'/>
Nov 07 15:16:21 user nova-compute[75018]:           </distances>
Nov 07 15:16:21 user nova-compute[75018]:           <cpus num='6'>
Nov 07 15:16:21 user nova-compute[75018]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 07 15:16:21 user nova-compute[75018]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 07 15:16:21 user nova-compute[75018]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 07 15:16:21 user nova-compute[75018]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 07 15:16:21 user nova-compute[75018]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 07 15:16:21 user nova-compute[75018]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 07 15:16:21 user nova-compute[75018]:           </cpus>
Nov 07 15:16:21 user nova-compute[75018]:         </cell>
Nov 07 15:16:21 user nova-compute[75018]:       </cells>
Nov 07 15:16:21 user nova-compute[75018]:     </topology>
Nov 07 15:16:21 user nova-compute[75018]:     <cache>
Nov 07 15:16:21 user nova-compute[75018]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 07 15:16:21 user nova-compute[75018]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 07 15:16:21 user nova-compute[75018]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 07 15:16:21 user nova-compute[75018]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 07 15:16:21 user nova-compute[75018]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 07 15:16:21 user nova-compute[75018]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 07 15:16:21 user nova-compute[75018]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 07 15:16:21 user nova-compute[75018]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 07 15:16:21 user nova-compute[75018]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 07 15:16:21 user nova-compute[75018]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 07 15:16:21 user nova-compute[75018]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 07 15:16:21 user nova-compute[75018]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 07 15:16:21 user nova-compute[75018]:     </cache>
Nov 07 15:16:21 user nova-compute[75018]:     <secmodel>
Nov 07 15:16:21 user nova-compute[75018]:       <model>apparmor</model>
Nov 07 15:16:21 user nova-compute[75018]:       <doi>0</doi>
Nov 07 15:16:21 user nova-compute[75018]:     </secmodel>
Nov 07 15:16:21 user nova-compute[75018]:     <secmodel>
Nov 07 15:16:21 user nova-compute[75018]:       <model>dac</model>
Nov 07 15:16:21 user nova-compute[75018]:       <doi>0</doi>
Nov 07 15:16:21 user nova-compute[75018]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 07 15:16:21 user nova-compute[75018]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 07 15:16:21 user nova-compute[75018]:     </secmodel>
Nov 07 15:16:21 user nova-compute[75018]:   </host>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='alpha'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>64</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>clipper</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='armv6l'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>integratorcp</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>borzoi</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>spitz</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>nuri</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>musca-b1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>versatileab</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>kzm</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>musca-a</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>smdkc210</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sx1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>z2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>tosa</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>sabrelite</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>realview-eb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>n810</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>n800</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>versatilepb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>terrier</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mainstone</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>midway</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>musicpal</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>microbit</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>cubieboard</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>verdex</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>netduino2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>raspi2b</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>cheetah</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>highbank</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>akita</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>connex</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>collie</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>raspi0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='armv7l'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>integratorcp</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>borzoi</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>spitz</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>nuri</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>musca-b1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>versatileab</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>kzm</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>musca-a</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>smdkc210</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sx1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>z2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>tosa</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>sabrelite</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>realview-eb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>n810</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>n800</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>versatilepb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>terrier</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mainstone</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>midway</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>musicpal</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>microbit</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>cubieboard</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>verdex</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>netduino2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>raspi2b</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>cheetah</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>highbank</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>akita</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>connex</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>collie</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>raspi0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='aarch64'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>64</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>integratorcp</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>borzoi</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>spitz</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>nuri</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>musca-b1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>versatileab</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>kzm</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>musca-a</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>smdkc210</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sx1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>z2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>tosa</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>sabrelite</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>realview-eb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>n810</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>n800</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>versatilepb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>terrier</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mainstone</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>midway</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>musicpal</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>microbit</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>cubieboard</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>verdex</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>netduino2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>raspi3b</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>raspi2b</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>cheetah</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>highbank</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>akita</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>connex</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>collie</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>raspi0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <acpi default='on' toggle='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='cris'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='i686'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>x-remote</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>isapc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>microvm</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='kvm'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <pae/>
Nov 07 15:16:21 user nova-compute[75018]:       <nonpae/>
Nov 07 15:16:21 user nova-compute[75018]:       <acpi default='on' toggle='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:       <apic default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='m68k'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>an5206</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>q800</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>next-cube</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='microblaze'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='microblazeel'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='mips'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='16'>malta</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mipssim</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='mipsel'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='16'>malta</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mipssim</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='mips64'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>64</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='16'>malta</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mipssim</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>pica61</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>magnum</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='mips64el'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>64</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='16'>malta</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mipssim</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>pica61</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>magnum</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='16'>boston</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='ppc'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>g3beige</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mac99</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>ppce500</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>pegasos2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sam460ex</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>bamboo</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>40p</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>ref405ep</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>taihu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='ppc64'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>64</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2048'>powernv9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>taihu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2048'>powernv10</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>ppce500</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>40p</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>pegasos2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>bamboo</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>g3beige</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mac99</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sam460ex</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>ref405ep</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2048'>powernv8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='ppc64le'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>64</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2048'>powernv9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>taihu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2048'>powernv10</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>ppce500</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>40p</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>pegasos2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>bamboo</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>g3beige</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>mac99</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sam460ex</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>ref405ep</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2048'>powernv8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='riscv32'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='8'>spike</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>opentitan</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='5'>sifive_u</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sifive_e</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='8'>virt</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='riscv64'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>64</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='8'>spike</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='5'>sifive_u</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>shakti_c</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sifive_e</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='8'>virt</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='s390x'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>64</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='sh4'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>shix</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>r2d</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='sh4eb'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>64</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>shix</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>r2d</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='sparc'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>SS-5</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>SS-20</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>LX</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>SS-4</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>SS-10</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>Voyager</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='sparc64'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>64</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sun4u</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>niagara</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>sun4v</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='x86_64'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>64</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>x-remote</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='1'>isapc</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>microvm</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='kvm'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <acpi default='on' toggle='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:       <apic default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='xtensa'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>sim</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>kc705</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>ml605</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>virt</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>lx200</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>lx60</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]:   <guest>
Nov 07 15:16:21 user nova-compute[75018]:     <os_type>hvm</os_type>
Nov 07 15:16:21 user nova-compute[75018]:     <arch name='xtensaeb'>
Nov 07 15:16:21 user nova-compute[75018]:       <wordsize>32</wordsize>
Nov 07 15:16:21 user nova-compute[75018]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='4'>sim</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>kc705</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>ml605</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>virt</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>lx200</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>lx60</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 07 15:16:21 user nova-compute[75018]:       <domain type='qemu'/>
Nov 07 15:16:21 user nova-compute[75018]:     </arch>
Nov 07 15:16:21 user nova-compute[75018]:     <features>
Nov 07 15:16:21 user nova-compute[75018]:       <cpuselection/>
Nov 07 15:16:21 user nova-compute[75018]:       <deviceboot/>
Nov 07 15:16:21 user nova-compute[75018]:       <disksnapshot default='on' toggle='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     </features>
Nov 07 15:16:21 user nova-compute[75018]:   </guest>
Nov 07 15:16:21 user nova-compute[75018]: </capabilities>
Nov 07 15:16:21 user nova-compute[75018]: 
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 07 15:16:21 user nova-compute[75018]: <domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:   <path>/usr/bin/qemu-system-i386</path>
Nov 07 15:16:21 user nova-compute[75018]:   <domain>kvm</domain>
Nov 07 15:16:21 user nova-compute[75018]:   <machine>pc-i440fx-jammy</machine>
Nov 07 15:16:21 user nova-compute[75018]:   <arch>i686</arch>
Nov 07 15:16:21 user nova-compute[75018]:   <vcpu max='255'/>
Nov 07 15:16:21 user nova-compute[75018]:   <iothreads supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:   <os supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='firmware'/>
Nov 07 15:16:21 user nova-compute[75018]:     <loader supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>rom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pflash</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='readonly'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>yes</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='secure'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </loader>
Nov 07 15:16:21 user nova-compute[75018]:   </os>
Nov 07 15:16:21 user nova-compute[75018]:   <cpu>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-passthrough' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='hostPassthroughMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='maximum' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='maximumMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>on</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-model' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <vendor>Intel</vendor>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ss'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='vmx'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='pcid'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='hypervisor'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arat'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='umip'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='md-clear'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibpb'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibrs'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='erms'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='lm'/>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='custom' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>qemu64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>qemu32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>phenom</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>n270</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>kvm64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>kvm32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>coreduo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>core2duo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>athlon</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Westmere-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Westmere</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Snowridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Penryn</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G5</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G4</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G1</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Nehalem-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Nehalem</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Rome</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Milan</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Dhyana</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cooperlake</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Conroe</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>486</model>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:   </cpu>
Nov 07 15:16:21 user nova-compute[75018]:   <memoryBacking supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='sourceType'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>file</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>anonymous</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>memfd</value>
Nov 07 15:16:21 user nova-compute[75018]:     </enum>
Nov 07 15:16:21 user nova-compute[75018]:   </memoryBacking>
Nov 07 15:16:21 user nova-compute[75018]:   <devices>
Nov 07 15:16:21 user nova-compute[75018]:     <disk supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='diskDevice'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>disk</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cdrom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>floppy</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>lun</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='bus'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>ide</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>fdc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sata</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </disk>
Nov 07 15:16:21 user nova-compute[75018]:     <graphics supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sdl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vnc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>spice</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egl-headless</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </graphics>
Nov 07 15:16:21 user nova-compute[75018]:     <video supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='modelType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cirrus</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vmvga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>qxl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>none</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>bochs</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>ramfb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </video>
Nov 07 15:16:21 user nova-compute[75018]:     <hostdev supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='mode'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>subsystem</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='startupPolicy'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>default</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>mandatory</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>requisite</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>optional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='subsysType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pci</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='capsType'/>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='pciBackend'/>
Nov 07 15:16:21 user nova-compute[75018]:     </hostdev>
Nov 07 15:16:21 user nova-compute[75018]:     <rng supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>random</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egd</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>builtin</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </rng>
Nov 07 15:16:21 user nova-compute[75018]:     <filesystem supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='driverType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>path</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>handle</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtiofs</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </filesystem>
Nov 07 15:16:21 user nova-compute[75018]:     <tpm supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-tis</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-crb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>passthrough</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>emulator</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </tpm>
Nov 07 15:16:21 user nova-compute[75018]:   </devices>
Nov 07 15:16:21 user nova-compute[75018]:   <features>
Nov 07 15:16:21 user nova-compute[75018]:     <gic supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     <vmcoreinfo supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <genid supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backingStoreInput supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backup supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <sev supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:   </features>
Nov 07 15:16:21 user nova-compute[75018]: </domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:  {{(pid=75018) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 07 15:16:21 user nova-compute[75018]: <domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:   <path>/usr/bin/qemu-system-i386</path>
Nov 07 15:16:21 user nova-compute[75018]:   <domain>kvm</domain>
Nov 07 15:16:21 user nova-compute[75018]:   <machine>pc-i440fx-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:   <arch>i686</arch>
Nov 07 15:16:21 user nova-compute[75018]:   <vcpu max='255'/>
Nov 07 15:16:21 user nova-compute[75018]:   <iothreads supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:   <os supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='firmware'/>
Nov 07 15:16:21 user nova-compute[75018]:     <loader supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>rom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pflash</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='readonly'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>yes</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='secure'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </loader>
Nov 07 15:16:21 user nova-compute[75018]:   </os>
Nov 07 15:16:21 user nova-compute[75018]:   <cpu>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-passthrough' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='hostPassthroughMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='maximum' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='maximumMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>on</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-model' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <vendor>Intel</vendor>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ss'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='vmx'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='pcid'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='hypervisor'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arat'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='umip'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='md-clear'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibpb'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibrs'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='erms'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='lm'/>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='custom' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>qemu64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>qemu32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>phenom</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>n270</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>kvm64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>kvm32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>coreduo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>core2duo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>athlon</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Westmere-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Westmere</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Snowridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Penryn</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G5</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G4</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G1</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Nehalem-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Nehalem</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Rome</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Milan</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Dhyana</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cooperlake</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Conroe</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>486</model>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:   </cpu>
Nov 07 15:16:21 user nova-compute[75018]:   <memoryBacking supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='sourceType'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>file</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>anonymous</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>memfd</value>
Nov 07 15:16:21 user nova-compute[75018]:     </enum>
Nov 07 15:16:21 user nova-compute[75018]:   </memoryBacking>
Nov 07 15:16:21 user nova-compute[75018]:   <devices>
Nov 07 15:16:21 user nova-compute[75018]:     <disk supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='diskDevice'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>disk</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cdrom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>floppy</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>lun</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='bus'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>ide</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>fdc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sata</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </disk>
Nov 07 15:16:21 user nova-compute[75018]:     <graphics supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sdl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vnc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>spice</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egl-headless</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </graphics>
Nov 07 15:16:21 user nova-compute[75018]:     <video supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='modelType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cirrus</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vmvga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>qxl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>none</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>bochs</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>ramfb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </video>
Nov 07 15:16:21 user nova-compute[75018]:     <hostdev supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='mode'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>subsystem</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='startupPolicy'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>default</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>mandatory</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>requisite</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>optional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='subsysType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pci</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='capsType'/>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='pciBackend'/>
Nov 07 15:16:21 user nova-compute[75018]:     </hostdev>
Nov 07 15:16:21 user nova-compute[75018]:     <rng supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>random</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egd</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>builtin</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </rng>
Nov 07 15:16:21 user nova-compute[75018]:     <filesystem supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='driverType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>path</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>handle</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtiofs</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </filesystem>
Nov 07 15:16:21 user nova-compute[75018]:     <tpm supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-tis</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-crb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>passthrough</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>emulator</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </tpm>
Nov 07 15:16:21 user nova-compute[75018]:   </devices>
Nov 07 15:16:21 user nova-compute[75018]:   <features>
Nov 07 15:16:21 user nova-compute[75018]:     <gic supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     <vmcoreinfo supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <genid supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backingStoreInput supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backup supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <sev supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:   </features>
Nov 07 15:16:21 user nova-compute[75018]: </domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:  {{(pid=75018) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 07 15:16:21 user nova-compute[75018]: <domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:   <path>/usr/bin/qemu-system-i386</path>
Nov 07 15:16:21 user nova-compute[75018]:   <domain>kvm</domain>
Nov 07 15:16:21 user nova-compute[75018]:   <machine>pc-q35-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:   <arch>i686</arch>
Nov 07 15:16:21 user nova-compute[75018]:   <vcpu max='288'/>
Nov 07 15:16:21 user nova-compute[75018]:   <iothreads supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:   <os supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='firmware'/>
Nov 07 15:16:21 user nova-compute[75018]:     <loader supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>rom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pflash</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='readonly'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>yes</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='secure'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </loader>
Nov 07 15:16:21 user nova-compute[75018]:   </os>
Nov 07 15:16:21 user nova-compute[75018]:   <cpu>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-passthrough' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='hostPassthroughMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='maximum' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='maximumMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>on</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-model' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <vendor>Intel</vendor>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ss'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='vmx'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='pcid'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='hypervisor'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arat'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='umip'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='md-clear'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibpb'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibrs'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='erms'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='lm'/>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='custom' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>qemu64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>qemu32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>phenom</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>n270</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>kvm64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>kvm32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>coreduo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>core2duo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>athlon</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Westmere-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Westmere</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Snowridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Penryn</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G5</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G4</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G1</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Nehalem-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Nehalem</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Rome</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Milan</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Dhyana</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cooperlake</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Conroe</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>486</model>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:   </cpu>
Nov 07 15:16:21 user nova-compute[75018]:   <memoryBacking supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='sourceType'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>file</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>anonymous</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>memfd</value>
Nov 07 15:16:21 user nova-compute[75018]:     </enum>
Nov 07 15:16:21 user nova-compute[75018]:   </memoryBacking>
Nov 07 15:16:21 user nova-compute[75018]:   <devices>
Nov 07 15:16:21 user nova-compute[75018]:     <disk supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='diskDevice'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>disk</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cdrom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>floppy</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>lun</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='bus'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>fdc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sata</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </disk>
Nov 07 15:16:21 user nova-compute[75018]:     <graphics supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sdl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vnc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>spice</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egl-headless</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </graphics>
Nov 07 15:16:21 user nova-compute[75018]:     <video supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='modelType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cirrus</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vmvga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>qxl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>none</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>bochs</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>ramfb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </video>
Nov 07 15:16:21 user nova-compute[75018]:     <hostdev supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='mode'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>subsystem</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='startupPolicy'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>default</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>mandatory</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>requisite</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>optional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='subsysType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pci</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='capsType'/>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='pciBackend'/>
Nov 07 15:16:21 user nova-compute[75018]:     </hostdev>
Nov 07 15:16:21 user nova-compute[75018]:     <rng supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>random</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egd</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>builtin</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </rng>
Nov 07 15:16:21 user nova-compute[75018]:     <filesystem supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='driverType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>path</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>handle</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtiofs</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </filesystem>
Nov 07 15:16:21 user nova-compute[75018]:     <tpm supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-tis</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-crb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>passthrough</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>emulator</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </tpm>
Nov 07 15:16:21 user nova-compute[75018]:   </devices>
Nov 07 15:16:21 user nova-compute[75018]:   <features>
Nov 07 15:16:21 user nova-compute[75018]:     <gic supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     <vmcoreinfo supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <genid supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backingStoreInput supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backup supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <sev supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:   </features>
Nov 07 15:16:21 user nova-compute[75018]: </domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:  {{(pid=75018) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 07 15:16:21 user nova-compute[75018]: <domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:   <path>/usr/bin/qemu-system-i386</path>
Nov 07 15:16:21 user nova-compute[75018]:   <domain>kvm</domain>
Nov 07 15:16:21 user nova-compute[75018]:   <machine>pc-q35-jammy</machine>
Nov 07 15:16:21 user nova-compute[75018]:   <arch>i686</arch>
Nov 07 15:16:21 user nova-compute[75018]:   <vcpu max='288'/>
Nov 07 15:16:21 user nova-compute[75018]:   <iothreads supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:   <os supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='firmware'/>
Nov 07 15:16:21 user nova-compute[75018]:     <loader supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>rom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pflash</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='readonly'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>yes</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='secure'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </loader>
Nov 07 15:16:21 user nova-compute[75018]:   </os>
Nov 07 15:16:21 user nova-compute[75018]:   <cpu>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-passthrough' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='hostPassthroughMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='maximum' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='maximumMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>on</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-model' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <vendor>Intel</vendor>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ss'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='vmx'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='pcid'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='hypervisor'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arat'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='umip'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='md-clear'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibpb'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibrs'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='erms'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='lm'/>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='custom' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>qemu64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>qemu32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>phenom</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>n270</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>kvm64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>kvm32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>coreduo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>core2duo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>athlon</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Westmere-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Westmere</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Snowridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Penryn</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G5</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G4</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G1</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Nehalem-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Nehalem</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Rome</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Milan</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Dhyana</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cooperlake</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Conroe</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>486</model>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:   </cpu>
Nov 07 15:16:21 user nova-compute[75018]:   <memoryBacking supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='sourceType'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>file</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>anonymous</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>memfd</value>
Nov 07 15:16:21 user nova-compute[75018]:     </enum>
Nov 07 15:16:21 user nova-compute[75018]:   </memoryBacking>
Nov 07 15:16:21 user nova-compute[75018]:   <devices>
Nov 07 15:16:21 user nova-compute[75018]:     <disk supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='diskDevice'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>disk</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cdrom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>floppy</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>lun</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='bus'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>fdc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sata</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </disk>
Nov 07 15:16:21 user nova-compute[75018]:     <graphics supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sdl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vnc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>spice</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egl-headless</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </graphics>
Nov 07 15:16:21 user nova-compute[75018]:     <video supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='modelType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cirrus</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vmvga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>qxl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>none</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>bochs</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>ramfb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </video>
Nov 07 15:16:21 user nova-compute[75018]:     <hostdev supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='mode'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>subsystem</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='startupPolicy'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>default</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>mandatory</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>requisite</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>optional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='subsysType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pci</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='capsType'/>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='pciBackend'/>
Nov 07 15:16:21 user nova-compute[75018]:     </hostdev>
Nov 07 15:16:21 user nova-compute[75018]:     <rng supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>random</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egd</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>builtin</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </rng>
Nov 07 15:16:21 user nova-compute[75018]:     <filesystem supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='driverType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>path</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>handle</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtiofs</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </filesystem>
Nov 07 15:16:21 user nova-compute[75018]:     <tpm supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-tis</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-crb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>passthrough</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>emulator</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </tpm>
Nov 07 15:16:21 user nova-compute[75018]:   </devices>
Nov 07 15:16:21 user nova-compute[75018]:   <features>
Nov 07 15:16:21 user nova-compute[75018]:     <gic supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     <vmcoreinfo supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <genid supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backingStoreInput supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backup supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <sev supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:   </features>
Nov 07 15:16:21 user nova-compute[75018]: </domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:  {{(pid=75018) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 07 15:16:21 user nova-compute[75018]: <domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 07 15:16:21 user nova-compute[75018]:   <domain>kvm</domain>
Nov 07 15:16:21 user nova-compute[75018]:   <machine>pc-i440fx-jammy</machine>
Nov 07 15:16:21 user nova-compute[75018]:   <arch>x86_64</arch>
Nov 07 15:16:21 user nova-compute[75018]:   <vcpu max='255'/>
Nov 07 15:16:21 user nova-compute[75018]:   <iothreads supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:   <os supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='firmware'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>efi</value>
Nov 07 15:16:21 user nova-compute[75018]:     </enum>
Nov 07 15:16:21 user nova-compute[75018]:     <loader supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>rom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pflash</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='readonly'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>yes</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='secure'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </loader>
Nov 07 15:16:21 user nova-compute[75018]:   </os>
Nov 07 15:16:21 user nova-compute[75018]:   <cpu>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-passthrough' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='hostPassthroughMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>on</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='maximum' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='maximumMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>on</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-model' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <vendor>Intel</vendor>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ss'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='vmx'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='pcid'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='hypervisor'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arat'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='umip'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='md-clear'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='invtsc'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibpb'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibrs'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='rsba'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='pschange-mc-no'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='erms'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='custom' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>qemu64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>qemu32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>phenom</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>n270</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>kvm64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>kvm32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>coreduo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>core2duo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>athlon</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Westmere-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Westmere</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Snowridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Penryn</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G5</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G4</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Opteron_G1</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Nehalem</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Rome</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Milan</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Dhyana</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cooperlake</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Conroe</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>486</model>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:   </cpu>
Nov 07 15:16:21 user nova-compute[75018]:   <memoryBacking supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='sourceType'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>file</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>anonymous</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>memfd</value>
Nov 07 15:16:21 user nova-compute[75018]:     </enum>
Nov 07 15:16:21 user nova-compute[75018]:   </memoryBacking>
Nov 07 15:16:21 user nova-compute[75018]:   <devices>
Nov 07 15:16:21 user nova-compute[75018]:     <disk supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='diskDevice'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>disk</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cdrom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>floppy</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>lun</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='bus'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>ide</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>fdc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sata</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </disk>
Nov 07 15:16:21 user nova-compute[75018]:     <graphics supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sdl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vnc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>spice</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egl-headless</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </graphics>
Nov 07 15:16:21 user nova-compute[75018]:     <video supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='modelType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cirrus</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vmvga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>qxl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>none</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>bochs</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>ramfb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </video>
Nov 07 15:16:21 user nova-compute[75018]:     <hostdev supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='mode'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>subsystem</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='startupPolicy'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>default</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>mandatory</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>requisite</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>optional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='subsysType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pci</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='capsType'/>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='pciBackend'/>
Nov 07 15:16:21 user nova-compute[75018]:     </hostdev>
Nov 07 15:16:21 user nova-compute[75018]:     <rng supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>random</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egd</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>builtin</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </rng>
Nov 07 15:16:21 user nova-compute[75018]:     <filesystem supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='driverType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>path</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>handle</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtiofs</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </filesystem>
Nov 07 15:16:21 user nova-compute[75018]:     <tpm supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-tis</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-crb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>passthrough</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>emulator</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </tpm>
Nov 07 15:16:21 user nova-compute[75018]:   </devices>
Nov 07 15:16:21 user nova-compute[75018]:   <features>
Nov 07 15:16:21 user nova-compute[75018]:     <gic supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     <vmcoreinfo supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <genid supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backingStoreInput supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backup supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <sev supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:   </features>
Nov 07 15:16:21 user nova-compute[75018]: </domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:  {{(pid=75018) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 07 15:16:21 user nova-compute[75018]: <domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 07 15:16:21 user nova-compute[75018]:   <domain>kvm</domain>
Nov 07 15:16:21 user nova-compute[75018]:   <machine>pc-i440fx-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:   <arch>x86_64</arch>
Nov 07 15:16:21 user nova-compute[75018]:   <vcpu max='255'/>
Nov 07 15:16:21 user nova-compute[75018]:   <iothreads supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:   <os supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='firmware'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>efi</value>
Nov 07 15:16:21 user nova-compute[75018]:     </enum>
Nov 07 15:16:21 user nova-compute[75018]:     <loader supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>rom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pflash</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='readonly'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>yes</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='secure'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </loader>
Nov 07 15:16:21 user nova-compute[75018]:   </os>
Nov 07 15:16:21 user nova-compute[75018]:   <cpu>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-passthrough' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='hostPassthroughMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>on</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='maximum' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='maximumMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>on</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-model' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <vendor>Intel</vendor>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ss'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='vmx'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='pcid'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='hypervisor'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arat'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='umip'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='md-clear'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='invtsc'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibpb'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibrs'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='rsba'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='pschange-mc-no'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='erms'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='custom' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>qemu64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>qemu32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>phenom</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>n270</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>kvm64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>kvm32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>coreduo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>core2duo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>athlon</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Westmere-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Westmere</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Snowridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Penryn</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G5</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G4</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Opteron_G1</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Nehalem</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Rome</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Milan</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Dhyana</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cooperlake</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Conroe</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>486</model>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:   </cpu>
Nov 07 15:16:21 user nova-compute[75018]:   <memoryBacking supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='sourceType'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>file</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>anonymous</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>memfd</value>
Nov 07 15:16:21 user nova-compute[75018]:     </enum>
Nov 07 15:16:21 user nova-compute[75018]:   </memoryBacking>
Nov 07 15:16:21 user nova-compute[75018]:   <devices>
Nov 07 15:16:21 user nova-compute[75018]:     <disk supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='diskDevice'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>disk</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cdrom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>floppy</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>lun</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='bus'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>ide</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>fdc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sata</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </disk>
Nov 07 15:16:21 user nova-compute[75018]:     <graphics supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sdl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vnc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>spice</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egl-headless</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </graphics>
Nov 07 15:16:21 user nova-compute[75018]:     <video supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='modelType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cirrus</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vmvga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>qxl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>none</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>bochs</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>ramfb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </video>
Nov 07 15:16:21 user nova-compute[75018]:     <hostdev supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='mode'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>subsystem</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='startupPolicy'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>default</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>mandatory</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>requisite</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>optional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='subsysType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pci</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='capsType'/>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='pciBackend'/>
Nov 07 15:16:21 user nova-compute[75018]:     </hostdev>
Nov 07 15:16:21 user nova-compute[75018]:     <rng supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>random</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egd</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>builtin</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </rng>
Nov 07 15:16:21 user nova-compute[75018]:     <filesystem supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='driverType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>path</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>handle</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtiofs</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </filesystem>
Nov 07 15:16:21 user nova-compute[75018]:     <tpm supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-tis</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-crb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>passthrough</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>emulator</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </tpm>
Nov 07 15:16:21 user nova-compute[75018]:   </devices>
Nov 07 15:16:21 user nova-compute[75018]:   <features>
Nov 07 15:16:21 user nova-compute[75018]:     <gic supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     <vmcoreinfo supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <genid supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backingStoreInput supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backup supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <sev supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:   </features>
Nov 07 15:16:21 user nova-compute[75018]: </domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:  {{(pid=75018) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 07 15:16:21 user nova-compute[75018]: <domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 07 15:16:21 user nova-compute[75018]:   <domain>kvm</domain>
Nov 07 15:16:21 user nova-compute[75018]:   <machine>pc-q35-6.2</machine>
Nov 07 15:16:21 user nova-compute[75018]:   <arch>x86_64</arch>
Nov 07 15:16:21 user nova-compute[75018]:   <vcpu max='288'/>
Nov 07 15:16:21 user nova-compute[75018]:   <iothreads supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:   <os supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='firmware'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>efi</value>
Nov 07 15:16:21 user nova-compute[75018]:     </enum>
Nov 07 15:16:21 user nova-compute[75018]:     <loader supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>rom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pflash</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='readonly'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>yes</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='secure'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>yes</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </loader>
Nov 07 15:16:21 user nova-compute[75018]:   </os>
Nov 07 15:16:21 user nova-compute[75018]:   <cpu>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-passthrough' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='hostPassthroughMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>on</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='maximum' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='maximumMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>on</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-model' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <vendor>Intel</vendor>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ss'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='vmx'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='pcid'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='hypervisor'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arat'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='umip'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='md-clear'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='invtsc'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibpb'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibrs'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='rsba'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='pschange-mc-no'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='erms'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='custom' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>qemu64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>qemu32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>phenom</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>n270</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>kvm64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>kvm32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>coreduo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>core2duo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>athlon</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Westmere-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Westmere</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Snowridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Penryn</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G5</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G4</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Opteron_G1</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Nehalem</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Rome</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Milan</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Dhyana</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cooperlake</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Conroe</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>486</model>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:   </cpu>
Nov 07 15:16:21 user nova-compute[75018]:   <memoryBacking supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='sourceType'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>file</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>anonymous</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>memfd</value>
Nov 07 15:16:21 user nova-compute[75018]:     </enum>
Nov 07 15:16:21 user nova-compute[75018]:   </memoryBacking>
Nov 07 15:16:21 user nova-compute[75018]:   <devices>
Nov 07 15:16:21 user nova-compute[75018]:     <disk supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='diskDevice'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>disk</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cdrom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>floppy</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>lun</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='bus'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>fdc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sata</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </disk>
Nov 07 15:16:21 user nova-compute[75018]:     <graphics supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sdl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vnc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>spice</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egl-headless</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </graphics>
Nov 07 15:16:21 user nova-compute[75018]:     <video supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='modelType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cirrus</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vmvga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>qxl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>none</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>bochs</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>ramfb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </video>
Nov 07 15:16:21 user nova-compute[75018]:     <hostdev supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='mode'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>subsystem</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='startupPolicy'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>default</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>mandatory</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>requisite</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>optional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='subsysType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pci</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='capsType'/>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='pciBackend'/>
Nov 07 15:16:21 user nova-compute[75018]:     </hostdev>
Nov 07 15:16:21 user nova-compute[75018]:     <rng supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>random</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egd</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>builtin</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </rng>
Nov 07 15:16:21 user nova-compute[75018]:     <filesystem supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='driverType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>path</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>handle</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtiofs</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </filesystem>
Nov 07 15:16:21 user nova-compute[75018]:     <tpm supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-tis</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-crb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>passthrough</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>emulator</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </tpm>
Nov 07 15:16:21 user nova-compute[75018]:   </devices>
Nov 07 15:16:21 user nova-compute[75018]:   <features>
Nov 07 15:16:21 user nova-compute[75018]:     <gic supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     <vmcoreinfo supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <genid supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backingStoreInput supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backup supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <sev supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:   </features>
Nov 07 15:16:21 user nova-compute[75018]: </domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:  {{(pid=75018) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 07 15:16:21 user nova-compute[75018]: <domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 07 15:16:21 user nova-compute[75018]:   <domain>kvm</domain>
Nov 07 15:16:21 user nova-compute[75018]:   <machine>pc-q35-jammy</machine>
Nov 07 15:16:21 user nova-compute[75018]:   <arch>x86_64</arch>
Nov 07 15:16:21 user nova-compute[75018]:   <vcpu max='288'/>
Nov 07 15:16:21 user nova-compute[75018]:   <iothreads supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:   <os supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='firmware'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>efi</value>
Nov 07 15:16:21 user nova-compute[75018]:     </enum>
Nov 07 15:16:21 user nova-compute[75018]:     <loader supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>rom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pflash</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='readonly'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>yes</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='secure'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>yes</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>no</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </loader>
Nov 07 15:16:21 user nova-compute[75018]:   </os>
Nov 07 15:16:21 user nova-compute[75018]:   <cpu>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-passthrough' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='hostPassthroughMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>on</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='maximum' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='maximumMigratable'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>on</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>off</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='host-model' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <vendor>Intel</vendor>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ss'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='vmx'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='pcid'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='hypervisor'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arat'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='umip'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='md-clear'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='invtsc'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibpb'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='ibrs'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-stibp'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='rsba'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='require' name='pschange-mc-no'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='erms'/>
Nov 07 15:16:21 user nova-compute[75018]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:     <mode name='custom' supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>qemu64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>qemu32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>phenom</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>pentium</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>n270</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>kvm64</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>kvm32</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>coreduo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>core2duo</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>athlon</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Westmere-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Westmere</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Snowridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Skylake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>SandyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Penryn</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G5</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G4</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G3</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Opteron_G2</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Opteron_G1</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Nehalem</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>IvyBridge</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Icelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Haswell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Rome</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-Milan</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>EPYC</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Dhyana</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cooperlake</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>Conroe</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='no'>Broadwell</model>
Nov 07 15:16:21 user nova-compute[75018]:       <model usable='yes'>486</model>
Nov 07 15:16:21 user nova-compute[75018]:     </mode>
Nov 07 15:16:21 user nova-compute[75018]:   </cpu>
Nov 07 15:16:21 user nova-compute[75018]:   <memoryBacking supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:     <enum name='sourceType'>
Nov 07 15:16:21 user nova-compute[75018]:       <value>file</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>anonymous</value>
Nov 07 15:16:21 user nova-compute[75018]:       <value>memfd</value>
Nov 07 15:16:21 user nova-compute[75018]:     </enum>
Nov 07 15:16:21 user nova-compute[75018]:   </memoryBacking>
Nov 07 15:16:21 user nova-compute[75018]:   <devices>
Nov 07 15:16:21 user nova-compute[75018]:     <disk supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='diskDevice'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>disk</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cdrom</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>floppy</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>lun</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='bus'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>fdc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sata</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </disk>
Nov 07 15:16:21 user nova-compute[75018]:     <graphics supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='type'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>sdl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vnc</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>spice</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egl-headless</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </graphics>
Nov 07 15:16:21 user nova-compute[75018]:     <video supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='modelType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>cirrus</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>vmvga</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>qxl</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>none</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>bochs</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>ramfb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </video>
Nov 07 15:16:21 user nova-compute[75018]:     <hostdev supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='mode'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>subsystem</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='startupPolicy'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>default</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>mandatory</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>requisite</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>optional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='subsysType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>usb</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>pci</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>scsi</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='capsType'/>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='pciBackend'/>
Nov 07 15:16:21 user nova-compute[75018]:     </hostdev>
Nov 07 15:16:21 user nova-compute[75018]:     <rng supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtio-non-transitional</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>random</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>egd</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>builtin</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </rng>
Nov 07 15:16:21 user nova-compute[75018]:     <filesystem supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='driverType'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>path</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>handle</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>virtiofs</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </filesystem>
Nov 07 15:16:21 user nova-compute[75018]:     <tpm supported='yes'>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='model'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-tis</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>tpm-crb</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:       <enum name='backendModel'>
Nov 07 15:16:21 user nova-compute[75018]:         <value>passthrough</value>
Nov 07 15:16:21 user nova-compute[75018]:         <value>emulator</value>
Nov 07 15:16:21 user nova-compute[75018]:       </enum>
Nov 07 15:16:21 user nova-compute[75018]:     </tpm>
Nov 07 15:16:21 user nova-compute[75018]:   </devices>
Nov 07 15:16:21 user nova-compute[75018]:   <features>
Nov 07 15:16:21 user nova-compute[75018]:     <gic supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:     <vmcoreinfo supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <genid supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backingStoreInput supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <backup supported='yes'/>
Nov 07 15:16:21 user nova-compute[75018]:     <sev supported='no'/>
Nov 07 15:16:21 user nova-compute[75018]:   </features>
Nov 07 15:16:21 user nova-compute[75018]: </domainCapabilities>
Nov 07 15:16:21 user nova-compute[75018]:  {{(pid=75018) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75018) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75018) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Checking secure boot support for host arch (x86_64) {{(pid=75018) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Checking secure boot support for host arch (x86_64) {{(pid=75018) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Checking secure boot support for host arch (x86_64) {{(pid=75018) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Checking secure boot support for host arch (x86_64) {{(pid=75018) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Checking secure boot support for host arch (x86_64) {{(pid=75018) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 07 15:16:21 user nova-compute[75018]: INFO nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Secure Boot support detected
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] cpu compare xml: <cpu match="exact">
Nov 07 15:16:21 user nova-compute[75018]:   <model>Nehalem</model>
Nov 07 15:16:21 user nova-compute[75018]: </cpu>
Nov 07 15:16:21 user nova-compute[75018]:  {{(pid=75018) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 07 15:16:21 user nova-compute[75018]: INFO nova.virt.node [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Generated node identity 54e83767-2936-4d0e-a90c-1dd381218079
Nov 07 15:16:21 user nova-compute[75018]: INFO nova.virt.node [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Wrote node identity 54e83767-2936-4d0e-a90c-1dd381218079 to /opt/stack/data/nova/compute_id
Nov 07 15:16:21 user nova-compute[75018]: WARNING nova.compute.manager [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Compute nodes ['54e83767-2936-4d0e-a90c-1dd381218079'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 07 15:16:21 user nova-compute[75018]: INFO nova.compute.manager [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 07 15:16:21 user nova-compute[75018]: WARNING nova.compute.manager [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 07 15:16:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:16:21 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:16:22 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:16:22 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Hypervisor/Node resource view: name=user free_ram=10937MB free_disk=26.048450469970703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:16:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:16:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:16:22 user nova-compute[75018]: WARNING nova.compute.resource_tracker [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] No compute node record for user:54e83767-2936-4d0e-a90c-1dd381218079: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 54e83767-2936-4d0e-a90c-1dd381218079 could not be found.
Nov 07 15:16:22 user nova-compute[75018]: INFO nova.compute.resource_tracker [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Compute node record created for user:user with uuid: 54e83767-2936-4d0e-a90c-1dd381218079
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:16:22 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] [req-92dcc183-88b4-470e-a278-a7e7cc1a0299] Created resource provider record via placement API for resource provider with UUID 54e83767-2936-4d0e-a90c-1dd381218079 and name user.
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75018) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 07 15:16:22 user nova-compute[75018]: INFO nova.virt.libvirt.host [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] kernel doesn't support AMD SEV
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Libvirt baseline CPU <cpu>
Nov 07 15:16:22 user nova-compute[75018]:   <arch>x86_64</arch>
Nov 07 15:16:22 user nova-compute[75018]:   <model>Nehalem</model>
Nov 07 15:16:22 user nova-compute[75018]:   <vendor>Intel</vendor>
Nov 07 15:16:22 user nova-compute[75018]:   <topology sockets="6" cores="1" threads="1"/>
Nov 07 15:16:22 user nova-compute[75018]: </cpu>
Nov 07 15:16:22 user nova-compute[75018]:  {{(pid=75018) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Updated inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Updating resource provider 54e83767-2936-4d0e-a90c-1dd381218079 generation from 0 to 1 during operation: update_inventory {{(pid=75018) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Updating resource provider 54e83767-2936-4d0e-a90c-1dd381218079 generation from 1 to 2 during operation: update_traits {{(pid=75018) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:16:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.service [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Creating RPC server for service compute {{(pid=75018) start /opt/stack/nova/nova/service.py:182}}
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.service [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] Join ServiceGroup membership for this service compute {{(pid=75018) start /opt/stack/nova/nova/service.py:199}}
Nov 07 15:16:22 user nova-compute[75018]: DEBUG nova.servicegroup.drivers.db [None req-d75eac6e-a16a-4c30-8fb2-48af61ab78e3 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75018) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 07 15:17:11 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:17:11 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:17:13 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:17:13 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:17:13 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=10376MB free_disk=25.95227813720703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:17:13 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:17:14 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:17:14 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:17:14 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:17:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:18:14 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:18:14 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:18:14 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=10304MB free_disk=26.005512237548828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:18:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:18:15 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:18:15 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:18:15 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:18:15 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:18:15 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:18:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:18:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:18:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:18:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:18:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:19:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:19:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:19:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:19:15 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:19:15 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:19:15 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=10283MB free_disk=25.769004821777344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:19:15 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:19:16 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:19:16 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:19:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:19:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:19:18 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:20:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:20:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:20:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:20:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:20:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:20:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:20:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 15:20:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 15:20:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:20:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:20:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:20:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:15 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:20:15 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:20:15 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:20:15 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=9599MB free_disk=25.79688262939453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:20:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:20:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:20:16 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:20:16 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:20:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:20:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:20:18 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:20:19 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:20:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:20:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:20:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:20:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:26 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:20:26 user nova-compute[75018]: INFO nova.compute.claims [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Claim successful on node user
Nov 07 15:20:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:26 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:20:26 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:20:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:20:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.521s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:26 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:20:26 user nova-compute[75018]: INFO nova.compute.claims [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Claim successful on node user
Nov 07 15:20:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:20:26 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:20:26 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:20:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:20:27 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Creating image(s)
Nov 07 15:20:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "/opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "/opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "/opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.694s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:20:27 user nova-compute[75018]: INFO nova.compute.claims [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Claim successful on node user
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:20:27 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.policy [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6b867fc1e0742c3a3c5b76ed6fb756e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585cee0db41e41dda7f10ecfc90f1daf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:20:27 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Creating image(s)
Nov 07 15:20:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "/opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "/opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.policy [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c7596f1e0e748728fa459908f89aede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d8e2c039d94beea94f85d8d5a95d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e.part --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:20:27 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.933s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e.part --force-share --output=json" returned: 0 in 0.215s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG nova.virt.images [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] 667dc137-8627-496e-9a1f-9f5738befeda was qcow2, converting to raw {{(pid=75018) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e.part /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e.converted {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:20:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:20:28 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e.part /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e.converted" returned: 0 in 0.167s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e.converted --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:20:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Creating image(s)
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "/opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "/opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG nova.policy [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '961920ba4f4046eaa91025e52897db1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f985bd7fe8d429eaae3646f80b3fecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.395s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:28 user nova-compute[75018]: INFO oslo.privsep.daemon [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpe66pabhi/privsep.sock']
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.093s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.156s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:28 user sudo[84273]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpe66pabhi/privsep.sock
Nov 07 15:20:28 user sudo[84273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 07 15:20:30 user sudo[84273]: pam_unix(sudo:session): session closed for user root
Nov 07 15:20:30 user nova-compute[75018]: INFO oslo.privsep.daemon [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Spawned new privsep daemon via rootwrap
Nov 07 15:20:30 user nova-compute[75018]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 07 15:20:30 user nova-compute[75018]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 07 15:20:30 user nova-compute[75018]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 07 15:20:30 user nova-compute[75018]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84276
Nov 07 15:20:30 user nova-compute[75018]: WARNING oslo_privsep.priv_context [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] privsep daemon already running
Nov 07 15:20:30 user nova-compute[75018]: WARNING oslo_privsep.priv_context [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] privsep daemon already running
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Successfully created port: 05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.199s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.240s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk 1073741824" returned: 0 in 0.043s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.204s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.166s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Successfully created port: 07ef7c80-642e-4806-a038-12f69714fa5a {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.227s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk 1073741824" returned: 0 in 0.055s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.512s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Cannot resize image /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Ensure instance console log exists: /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Successfully created port: d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk 1073741824" returned: 0 in 0.041s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Cannot resize image /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Ensure instance console log exists: /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.169s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Cannot resize image /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Ensure instance console log exists: /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:33 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Successfully updated port: 05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:20:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:20:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquired lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:20:34 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:20:34 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Successfully updated port: 07ef7c80-642e-4806-a038-12f69714fa5a {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:20:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "refresh_cache-b8d3da3e-3927-4f4e-b9a3-994d45d5a408" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:20:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquired lock "refresh_cache-b8d3da3e-3927-4f4e-b9a3-994d45d5a408" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:20:34 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:20:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-fa32e9ad-2ba5-4990-8dea-23e924711b4d req-718e9663-2c35-4769-83aa-d45c7f0fc77d service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-changed-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:20:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-fa32e9ad-2ba5-4990-8dea-23e924711b4d req-718e9663-2c35-4769-83aa-d45c7f0fc77d service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Refreshing instance network info cache due to event network-changed-05429ce8-06b2-4693-bf2c-5d03a4343e00. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:20:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fa32e9ad-2ba5-4990-8dea-23e924711b4d req-718e9663-2c35-4769-83aa-d45c7f0fc77d service nova] Acquiring lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:20:34 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:20:34 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Successfully updated port: d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquired lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-d6df201c-94bb-422a-9dbe-10002536f2b0 req-96e46bb1-7caf-4aa4-993c-6a1f5a201cb1 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received event network-changed-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-d6df201c-94bb-422a-9dbe-10002536f2b0 req-96e46bb1-7caf-4aa4-993c-6a1f5a201cb1 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Refreshing instance network info cache due to event network-changed-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d6df201c-94bb-422a-9dbe-10002536f2b0 req-96e46bb1-7caf-4aa4-993c-6a1f5a201cb1 service nova] Acquiring lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating instance_info_cache with network_info: [{"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Releasing lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Instance network_info: |[{"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fa32e9ad-2ba5-4990-8dea-23e924711b4d req-718e9663-2c35-4769-83aa-d45c7f0fc77d service nova] Acquired lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.network.neutron [req-fa32e9ad-2ba5-4990-8dea-23e924711b4d req-718e9663-2c35-4769-83aa-d45c7f0fc77d service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Refreshing network info cache for port 05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Start _get_guest_xml network_info=[{"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:20:35 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:20:35 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077045494',display_name='tempest-ServerActionsTestOtherB-server-2077045494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077045494',id=1,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyBOTPm1HGMtOU1eTQJ9qDH8GeBUu2t+LNMgZBFFRP6tXXqDAukKUUiPODmfxQ+bXcX5mB9tkmMwlkDaHeyRpZSXxAXFTca2PcoYOgGrbYpszpri/wTQI3HjvvfuDY7fQ==',key_name='tempest-keypair-1660361084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='585cee0db41e41dda7f10ecfc90f1daf',ramdisk_id='',reservation_id='r-rh7e0y4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1343289164',owner_user_name='tempest-ServerActionsTestOtherB-1343289164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:20:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b867fc1e0742c3a3c5b76ed6fb756e',uuid=8257c590-204a-4fde-8487-79b8c0c87ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converting VIF {"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.objects.instance [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lazy-loading 'pci_devices' on Instance uuid 8257c590-204a-4fde-8487-79b8c0c87ea7 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:20:35 user nova-compute[75018]:   <uuid>8257c590-204a-4fde-8487-79b8c0c87ea7</uuid>
Nov 07 15:20:35 user nova-compute[75018]:   <name>instance-00000001</name>
Nov 07 15:20:35 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:20:35 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:20:35 user nova-compute[75018]:   <metadata>
Nov 07 15:20:35 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:20:35 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:20:35 user nova-compute[75018]:       <nova:name>tempest-ServerActionsTestOtherB-server-2077045494</nova:name>
Nov 07 15:20:35 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:20:35</nova:creationTime>
Nov 07 15:20:35 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:20:35 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:20:35 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:20:35 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:20:35 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:20:35 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:20:35 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:20:35 user nova-compute[75018]:       <nova:owner>
Nov 07 15:20:35 user nova-compute[75018]:         <nova:user uuid="c6b867fc1e0742c3a3c5b76ed6fb756e">tempest-ServerActionsTestOtherB-1343289164-project-member</nova:user>
Nov 07 15:20:35 user nova-compute[75018]:         <nova:project uuid="585cee0db41e41dda7f10ecfc90f1daf">tempest-ServerActionsTestOtherB-1343289164</nova:project>
Nov 07 15:20:35 user nova-compute[75018]:       </nova:owner>
Nov 07 15:20:35 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:20:35 user nova-compute[75018]:       <nova:ports>
Nov 07 15:20:35 user nova-compute[75018]:         <nova:port uuid="05429ce8-06b2-4693-bf2c-5d03a4343e00">
Nov 07 15:20:35 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 07 15:20:35 user nova-compute[75018]:         </nova:port>
Nov 07 15:20:35 user nova-compute[75018]:       </nova:ports>
Nov 07 15:20:35 user nova-compute[75018]:     </nova:instance>
Nov 07 15:20:35 user nova-compute[75018]:   </metadata>
Nov 07 15:20:35 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:20:35 user nova-compute[75018]:     <system>
Nov 07 15:20:35 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:20:35 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:20:35 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:20:35 user nova-compute[75018]:       <entry name="serial">8257c590-204a-4fde-8487-79b8c0c87ea7</entry>
Nov 07 15:20:35 user nova-compute[75018]:       <entry name="uuid">8257c590-204a-4fde-8487-79b8c0c87ea7</entry>
Nov 07 15:20:35 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:20:35 user nova-compute[75018]:     </system>
Nov 07 15:20:35 user nova-compute[75018]:   </sysinfo>
Nov 07 15:20:35 user nova-compute[75018]:   <os>
Nov 07 15:20:35 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:20:35 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:20:35 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:20:35 user nova-compute[75018]:   </os>
Nov 07 15:20:35 user nova-compute[75018]:   <features>
Nov 07 15:20:35 user nova-compute[75018]:     <acpi/>
Nov 07 15:20:35 user nova-compute[75018]:     <apic/>
Nov 07 15:20:35 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:20:35 user nova-compute[75018]:   </features>
Nov 07 15:20:35 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:20:35 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:20:35 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:20:35 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:20:35 user nova-compute[75018]:   </clock>
Nov 07 15:20:35 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:20:35 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:20:35 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:20:35 user nova-compute[75018]:   </cpu>
Nov 07 15:20:35 user nova-compute[75018]:   <devices>
Nov 07 15:20:35 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:20:35 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:20:35 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk"/>
Nov 07 15:20:35 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:20:35 user nova-compute[75018]:     </disk>
Nov 07 15:20:35 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:20:35 user nova-compute[75018]:       <mac address="fa:16:3e:a6:52:2c"/>
Nov 07 15:20:35 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:20:35 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:20:35 user nova-compute[75018]:       <target dev="tap05429ce8-06"/>
Nov 07 15:20:35 user nova-compute[75018]:     </interface>
Nov 07 15:20:35 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:20:35 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/console.log" append="off"/>
Nov 07 15:20:35 user nova-compute[75018]:     </serial>
Nov 07 15:20:35 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:20:35 user nova-compute[75018]:     <video>
Nov 07 15:20:35 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:20:35 user nova-compute[75018]:     </video>
Nov 07 15:20:35 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:20:35 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:20:35 user nova-compute[75018]:     </rng>
Nov 07 15:20:35 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:20:35 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:20:35 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:20:35 user nova-compute[75018]:     </memballoon>
Nov 07 15:20:35 user nova-compute[75018]:   </devices>
Nov 07 15:20:35 user nova-compute[75018]: </domain>
Nov 07 15:20:35 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077045494',display_name='tempest-ServerActionsTestOtherB-server-2077045494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077045494',id=1,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyBOTPm1HGMtOU1eTQJ9qDH8GeBUu2t+LNMgZBFFRP6tXXqDAukKUUiPODmfxQ+bXcX5mB9tkmMwlkDaHeyRpZSXxAXFTca2PcoYOgGrbYpszpri/wTQI3HjvvfuDY7fQ==',key_name='tempest-keypair-1660361084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='585cee0db41e41dda7f10ecfc90f1daf',ramdisk_id='',reservation_id='r-rh7e0y4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1343289164',owner_user_name='tempest-ServerActionsTestOtherB-1343289164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:20:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b867fc1e0742c3a3c5b76ed6fb756e',uuid=8257c590-204a-4fde-8487-79b8c0c87ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converting VIF {"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:20:35 user nova-compute[75018]: DEBUG os_vif [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Created schema index Interface.name {{(pid=75018) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Created schema index Port.name {{(pid=75018) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Created schema index Bridge.name {{(pid=75018) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [POLLOUT] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Updating instance_info_cache with network_info: [{"id": "07ef7c80-642e-4806-a038-12f69714fa5a", "address": "fa:16:3e:e9:c1:25", "network": {"id": "895875dd-6ac7-4acf-ad8a-c03e8ae599e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226052599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f985bd7fe8d429eaae3646f80b3fecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ef7c80-64", "ovs_interfaceid": "07ef7c80-642e-4806-a038-12f69714fa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Releasing lock "refresh_cache-b8d3da3e-3927-4f4e-b9a3-994d45d5a408" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Instance network_info: |[{"id": "07ef7c80-642e-4806-a038-12f69714fa5a", "address": "fa:16:3e:e9:c1:25", "network": {"id": "895875dd-6ac7-4acf-ad8a-c03e8ae599e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226052599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f985bd7fe8d429eaae3646f80b3fecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ef7c80-64", "ovs_interfaceid": "07ef7c80-642e-4806-a038-12f69714fa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Start _get_guest_xml network_info=[{"id": "07ef7c80-642e-4806-a038-12f69714fa5a", "address": "fa:16:3e:e9:c1:25", "network": {"id": "895875dd-6ac7-4acf-ad8a-c03e8ae599e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226052599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f985bd7fe8d429eaae3646f80b3fecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ef7c80-64", "ovs_interfaceid": "07ef7c80-642e-4806-a038-12f69714fa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05a28796-a71d-5119-a6e3-33094ba73afb', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:20:36 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:20:36 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-71303583',display_name='tempest-DeleteServersTestJSON-server-71303583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-71303583',id=3,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f985bd7fe8d429eaae3646f80b3fecc',ramdisk_id='',reservation_id='r-43249mw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-409494025',owner_user_name='tempest-DeleteServersTestJSON-409494025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:20:28Z,user_data=None,user_id='961920ba4f4046eaa91025e52897db1e',uuid=b8d3da3e-3927-4f4e-b9a3-994d45d5a408,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07ef7c80-642e-4806-a038-12f69714fa5a", "address": "fa:16:3e:e9:c1:25", "network": {"id": "895875dd-6ac7-4acf-ad8a-c03e8ae599e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226052599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f985bd7fe8d429eaae3646f80b3fecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ef7c80-64", "ovs_interfaceid": "07ef7c80-642e-4806-a038-12f69714fa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Converting VIF {"id": "07ef7c80-642e-4806-a038-12f69714fa5a", "address": "fa:16:3e:e9:c1:25", "network": {"id": "895875dd-6ac7-4acf-ad8a-c03e8ae599e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226052599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f985bd7fe8d429eaae3646f80b3fecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ef7c80-64", "ovs_interfaceid": "07ef7c80-642e-4806-a038-12f69714fa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c1:25,bridge_name='br-int',has_traffic_filtering=True,id=07ef7c80-642e-4806-a038-12f69714fa5a,network=Network(895875dd-6ac7-4acf-ad8a-c03e8ae599e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ef7c80-64') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lazy-loading 'pci_devices' on Instance uuid b8d3da3e-3927-4f4e-b9a3-994d45d5a408 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:36 user nova-compute[75018]: INFO oslo.privsep.daemon [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmprgz3xh2y/privsep.sock']
Nov 07 15:20:36 user sudo[84369]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmprgz3xh2y/privsep.sock
Nov 07 15:20:36 user sudo[84369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:20:36 user nova-compute[75018]:   <uuid>b8d3da3e-3927-4f4e-b9a3-994d45d5a408</uuid>
Nov 07 15:20:36 user nova-compute[75018]:   <name>instance-00000003</name>
Nov 07 15:20:36 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:20:36 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:20:36 user nova-compute[75018]:   <metadata>
Nov 07 15:20:36 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:20:36 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:20:36 user nova-compute[75018]:       <nova:name>tempest-DeleteServersTestJSON-server-71303583</nova:name>
Nov 07 15:20:36 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:20:36</nova:creationTime>
Nov 07 15:20:36 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:20:36 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:20:36 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:20:36 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:20:36 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:20:36 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:20:36 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:20:36 user nova-compute[75018]:       <nova:owner>
Nov 07 15:20:36 user nova-compute[75018]:         <nova:user uuid="961920ba4f4046eaa91025e52897db1e">tempest-DeleteServersTestJSON-409494025-project-member</nova:user>
Nov 07 15:20:36 user nova-compute[75018]:         <nova:project uuid="4f985bd7fe8d429eaae3646f80b3fecc">tempest-DeleteServersTestJSON-409494025</nova:project>
Nov 07 15:20:36 user nova-compute[75018]:       </nova:owner>
Nov 07 15:20:36 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:20:36 user nova-compute[75018]:       <nova:ports>
Nov 07 15:20:36 user nova-compute[75018]:         <nova:port uuid="07ef7c80-642e-4806-a038-12f69714fa5a">
Nov 07 15:20:36 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 07 15:20:36 user nova-compute[75018]:         </nova:port>
Nov 07 15:20:36 user nova-compute[75018]:       </nova:ports>
Nov 07 15:20:36 user nova-compute[75018]:     </nova:instance>
Nov 07 15:20:36 user nova-compute[75018]:   </metadata>
Nov 07 15:20:36 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:20:36 user nova-compute[75018]:     <system>
Nov 07 15:20:36 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:20:36 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:20:36 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:20:36 user nova-compute[75018]:       <entry name="serial">b8d3da3e-3927-4f4e-b9a3-994d45d5a408</entry>
Nov 07 15:20:36 user nova-compute[75018]:       <entry name="uuid">b8d3da3e-3927-4f4e-b9a3-994d45d5a408</entry>
Nov 07 15:20:36 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:20:36 user nova-compute[75018]:     </system>
Nov 07 15:20:36 user nova-compute[75018]:   </sysinfo>
Nov 07 15:20:36 user nova-compute[75018]:   <os>
Nov 07 15:20:36 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:20:36 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:20:36 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:20:36 user nova-compute[75018]:   </os>
Nov 07 15:20:36 user nova-compute[75018]:   <features>
Nov 07 15:20:36 user nova-compute[75018]:     <acpi/>
Nov 07 15:20:36 user nova-compute[75018]:     <apic/>
Nov 07 15:20:36 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:20:36 user nova-compute[75018]:   </features>
Nov 07 15:20:36 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:20:36 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:20:36 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:20:36 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:20:36 user nova-compute[75018]:   </clock>
Nov 07 15:20:36 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:20:36 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:20:36 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:20:36 user nova-compute[75018]:   </cpu>
Nov 07 15:20:36 user nova-compute[75018]:   <devices>
Nov 07 15:20:36 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:20:36 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:20:36 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk"/>
Nov 07 15:20:36 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:20:36 user nova-compute[75018]:     </disk>
Nov 07 15:20:36 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:20:36 user nova-compute[75018]:       <mac address="fa:16:3e:e9:c1:25"/>
Nov 07 15:20:36 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:20:36 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:20:36 user nova-compute[75018]:       <target dev="tap07ef7c80-64"/>
Nov 07 15:20:36 user nova-compute[75018]:     </interface>
Nov 07 15:20:36 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:20:36 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/console.log" append="off"/>
Nov 07 15:20:36 user nova-compute[75018]:     </serial>
Nov 07 15:20:36 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:20:36 user nova-compute[75018]:     <video>
Nov 07 15:20:36 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:20:36 user nova-compute[75018]:     </video>
Nov 07 15:20:36 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:20:36 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:20:36 user nova-compute[75018]:     </rng>
Nov 07 15:20:36 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:20:36 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:20:36 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:20:36 user nova-compute[75018]:     </memballoon>
Nov 07 15:20:36 user nova-compute[75018]:   </devices>
Nov 07 15:20:36 user nova-compute[75018]: </domain>
Nov 07 15:20:36 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-71303583',display_name='tempest-DeleteServersTestJSON-server-71303583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-71303583',id=3,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f985bd7fe8d429eaae3646f80b3fecc',ramdisk_id='',reservation_id='r-43249mw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-409494025',owner_user_name='tempest-DeleteServersTestJSON-409494025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:20:28Z,user_data=None,user_id='961920ba4f4046eaa91025e52897db1e',uuid=b8d3da3e-3927-4f4e-b9a3-994d45d5a408,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07ef7c80-642e-4806-a038-12f69714fa5a", "address": "fa:16:3e:e9:c1:25", "network": {"id": "895875dd-6ac7-4acf-ad8a-c03e8ae599e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226052599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f985bd7fe8d429eaae3646f80b3fecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ef7c80-64", "ovs_interfaceid": "07ef7c80-642e-4806-a038-12f69714fa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Converting VIF {"id": "07ef7c80-642e-4806-a038-12f69714fa5a", "address": "fa:16:3e:e9:c1:25", "network": {"id": "895875dd-6ac7-4acf-ad8a-c03e8ae599e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226052599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f985bd7fe8d429eaae3646f80b3fecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ef7c80-64", "ovs_interfaceid": "07ef7c80-642e-4806-a038-12f69714fa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c1:25,bridge_name='br-int',has_traffic_filtering=True,id=07ef7c80-642e-4806-a038-12f69714fa5a,network=Network(895875dd-6ac7-4acf-ad8a-c03e8ae599e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ef7c80-64') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG os_vif [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c1:25,bridge_name='br-int',has_traffic_filtering=True,id=07ef7c80-642e-4806-a038-12f69714fa5a,network=Network(895875dd-6ac7-4acf-ad8a-c03e8ae599e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ef7c80-64') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0358b0f1-c794-59ec-929c-d217a621f594', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updating instance_info_cache with network_info: [{"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Releasing lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Instance network_info: |[{"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d6df201c-94bb-422a-9dbe-10002536f2b0 req-96e46bb1-7caf-4aa4-993c-6a1f5a201cb1 service nova] Acquired lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.network.neutron [req-d6df201c-94bb-422a-9dbe-10002536f2b0 req-96e46bb1-7caf-4aa4-993c-6a1f5a201cb1 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Refreshing network info cache for port d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Start _get_guest_xml network_info=[{"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:20:36 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:20:36 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1081479971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1081479971',id=2,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGjOU9EW2aSTQ6LThOiRDF4utalg+tsviiM8orNc2RM3jBR/IYDksyXS2IStjIBlycILbeNViTcf4xQGQHqvqFePxwxGgPLyqjutal2484sVd/KwplLIrUEg+FkltYxhg==',key_name='tempest-keypair-376302873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1d8e2c039d94beea94f85d8d5a95d95',ramdisk_id='',reservation_id='r-hbv005jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-175335890',owner_user_name='tempest-AttachVolumeShelveTestJSON-175335890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:20:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c7596f1e0e748728fa459908f89aede',uuid=eb712362-b6b8-4a19-8f5b-8c374d6c4d87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converting VIF {"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d7fccd97-1db7-4dac-b2e9-6d5b4004aa70,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7fccd97-1d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'pci_devices' on Instance uuid eb712362-b6b8-4a19-8f5b-8c374d6c4d87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:20:36 user nova-compute[75018]:   <uuid>eb712362-b6b8-4a19-8f5b-8c374d6c4d87</uuid>
Nov 07 15:20:36 user nova-compute[75018]:   <name>instance-00000002</name>
Nov 07 15:20:36 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:20:36 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:20:36 user nova-compute[75018]:   <metadata>
Nov 07 15:20:36 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:20:36 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:20:36 user nova-compute[75018]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1081479971</nova:name>
Nov 07 15:20:36 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:20:36</nova:creationTime>
Nov 07 15:20:36 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:20:36 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:20:36 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:20:36 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:20:36 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:20:36 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:20:36 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:20:36 user nova-compute[75018]:       <nova:owner>
Nov 07 15:20:36 user nova-compute[75018]:         <nova:user uuid="9c7596f1e0e748728fa459908f89aede">tempest-AttachVolumeShelveTestJSON-175335890-project-member</nova:user>
Nov 07 15:20:36 user nova-compute[75018]:         <nova:project uuid="e1d8e2c039d94beea94f85d8d5a95d95">tempest-AttachVolumeShelveTestJSON-175335890</nova:project>
Nov 07 15:20:36 user nova-compute[75018]:       </nova:owner>
Nov 07 15:20:36 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:20:36 user nova-compute[75018]:       <nova:ports>
Nov 07 15:20:36 user nova-compute[75018]:         <nova:port uuid="d7fccd97-1db7-4dac-b2e9-6d5b4004aa70">
Nov 07 15:20:36 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 07 15:20:36 user nova-compute[75018]:         </nova:port>
Nov 07 15:20:36 user nova-compute[75018]:       </nova:ports>
Nov 07 15:20:36 user nova-compute[75018]:     </nova:instance>
Nov 07 15:20:36 user nova-compute[75018]:   </metadata>
Nov 07 15:20:36 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:20:36 user nova-compute[75018]:     <system>
Nov 07 15:20:36 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:20:36 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:20:36 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:20:36 user nova-compute[75018]:       <entry name="serial">eb712362-b6b8-4a19-8f5b-8c374d6c4d87</entry>
Nov 07 15:20:36 user nova-compute[75018]:       <entry name="uuid">eb712362-b6b8-4a19-8f5b-8c374d6c4d87</entry>
Nov 07 15:20:36 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:20:36 user nova-compute[75018]:     </system>
Nov 07 15:20:36 user nova-compute[75018]:   </sysinfo>
Nov 07 15:20:36 user nova-compute[75018]:   <os>
Nov 07 15:20:36 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:20:36 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:20:36 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:20:36 user nova-compute[75018]:   </os>
Nov 07 15:20:36 user nova-compute[75018]:   <features>
Nov 07 15:20:36 user nova-compute[75018]:     <acpi/>
Nov 07 15:20:36 user nova-compute[75018]:     <apic/>
Nov 07 15:20:36 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:20:36 user nova-compute[75018]:   </features>
Nov 07 15:20:36 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:20:36 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:20:36 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:20:36 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:20:36 user nova-compute[75018]:   </clock>
Nov 07 15:20:36 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:20:36 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:20:36 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:20:36 user nova-compute[75018]:   </cpu>
Nov 07 15:20:36 user nova-compute[75018]:   <devices>
Nov 07 15:20:36 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:20:36 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:20:36 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk"/>
Nov 07 15:20:36 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:20:36 user nova-compute[75018]:     </disk>
Nov 07 15:20:36 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:20:36 user nova-compute[75018]:       <mac address="fa:16:3e:be:3f:d4"/>
Nov 07 15:20:36 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:20:36 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:20:36 user nova-compute[75018]:       <target dev="tapd7fccd97-1d"/>
Nov 07 15:20:36 user nova-compute[75018]:     </interface>
Nov 07 15:20:36 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:20:36 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/console.log" append="off"/>
Nov 07 15:20:36 user nova-compute[75018]:     </serial>
Nov 07 15:20:36 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:20:36 user nova-compute[75018]:     <video>
Nov 07 15:20:36 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:20:36 user nova-compute[75018]:     </video>
Nov 07 15:20:36 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:20:36 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:20:36 user nova-compute[75018]:     </rng>
Nov 07 15:20:36 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:20:36 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:20:36 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:20:36 user nova-compute[75018]:     </memballoon>
Nov 07 15:20:36 user nova-compute[75018]:   </devices>
Nov 07 15:20:36 user nova-compute[75018]: </domain>
Nov 07 15:20:36 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1081479971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1081479971',id=2,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGjOU9EW2aSTQ6LThOiRDF4utalg+tsviiM8orNc2RM3jBR/IYDksyXS2IStjIBlycILbeNViTcf4xQGQHqvqFePxwxGgPLyqjutal2484sVd/KwplLIrUEg+FkltYxhg==',key_name='tempest-keypair-376302873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1d8e2c039d94beea94f85d8d5a95d95',ramdisk_id='',reservation_id='r-hbv005jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-175335890',owner_user_name='tempest-AttachVolumeShelveTestJSON-175335890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:20:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c7596f1e0e748728fa459908f89aede',uuid=eb712362-b6b8-4a19-8f5b-8c374d6c4d87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converting VIF {"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d7fccd97-1db7-4dac-b2e9-6d5b4004aa70,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7fccd97-1d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG os_vif [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d7fccd97-1db7-4dac-b2e9-6d5b4004aa70,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7fccd97-1d') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5103a24-3b25-5435-ad80-86da30217a57', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-a2b21901-57d0-4686-a358-9c95d34600d7 req-683eed8b-b822-46a3-b366-c6492bfc129c service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Received event network-changed-07ef7c80-642e-4806-a038-12f69714fa5a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-a2b21901-57d0-4686-a358-9c95d34600d7 req-683eed8b-b822-46a3-b366-c6492bfc129c service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Refreshing instance network info cache due to event network-changed-07ef7c80-642e-4806-a038-12f69714fa5a. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a2b21901-57d0-4686-a358-9c95d34600d7 req-683eed8b-b822-46a3-b366-c6492bfc129c service nova] Acquiring lock "refresh_cache-b8d3da3e-3927-4f4e-b9a3-994d45d5a408" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a2b21901-57d0-4686-a358-9c95d34600d7 req-683eed8b-b822-46a3-b366-c6492bfc129c service nova] Acquired lock "refresh_cache-b8d3da3e-3927-4f4e-b9a3-994d45d5a408" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:20:36 user nova-compute[75018]: DEBUG nova.network.neutron [req-a2b21901-57d0-4686-a358-9c95d34600d7 req-683eed8b-b822-46a3-b366-c6492bfc129c service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Refreshing network info cache for port 07ef7c80-642e-4806-a038-12f69714fa5a {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:20:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-fa32e9ad-2ba5-4990-8dea-23e924711b4d req-718e9663-2c35-4769-83aa-d45c7f0fc77d service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updated VIF entry in instance network info cache for port 05429ce8-06b2-4693-bf2c-5d03a4343e00. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:20:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-fa32e9ad-2ba5-4990-8dea-23e924711b4d req-718e9663-2c35-4769-83aa-d45c7f0fc77d service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating instance_info_cache with network_info: [{"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:20:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fa32e9ad-2ba5-4990-8dea-23e924711b4d req-718e9663-2c35-4769-83aa-d45c7f0fc77d service nova] Releasing lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:20:37 user sudo[84369]: pam_unix(sudo:session): session closed for user root
Nov 07 15:20:37 user nova-compute[75018]: INFO oslo.privsep.daemon [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Spawned new privsep daemon via rootwrap
Nov 07 15:20:37 user nova-compute[75018]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 07 15:20:37 user nova-compute[75018]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 07 15:20:37 user nova-compute[75018]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 07 15:20:37 user nova-compute[75018]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84374
Nov 07 15:20:37 user nova-compute[75018]: WARNING oslo_privsep.priv_context [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] privsep daemon already running
Nov 07 15:20:37 user nova-compute[75018]: WARNING oslo_privsep.priv_context [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] privsep daemon already running
Nov 07 15:20:38 user nova-compute[75018]: DEBUG nova.network.neutron [req-d6df201c-94bb-422a-9dbe-10002536f2b0 req-96e46bb1-7caf-4aa4-993c-6a1f5a201cb1 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updated VIF entry in instance network info cache for port d7fccd97-1db7-4dac-b2e9-6d5b4004aa70. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG nova.network.neutron [req-d6df201c-94bb-422a-9dbe-10002536f2b0 req-96e46bb1-7caf-4aa4-993c-6a1f5a201cb1 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updating instance_info_cache with network_info: [{"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d6df201c-94bb-422a-9dbe-10002536f2b0 req-96e46bb1-7caf-4aa4-993c-6a1f5a201cb1 service nova] Releasing lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG nova.network.neutron [req-a2b21901-57d0-4686-a358-9c95d34600d7 req-683eed8b-b822-46a3-b366-c6492bfc129c service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Updated VIF entry in instance network info cache for port 07ef7c80-642e-4806-a038-12f69714fa5a. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG nova.network.neutron [req-a2b21901-57d0-4686-a358-9c95d34600d7 req-683eed8b-b822-46a3-b366-c6492bfc129c service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Updating instance_info_cache with network_info: [{"id": "07ef7c80-642e-4806-a038-12f69714fa5a", "address": "fa:16:3e:e9:c1:25", "network": {"id": "895875dd-6ac7-4acf-ad8a-c03e8ae599e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226052599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f985bd7fe8d429eaae3646f80b3fecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ef7c80-64", "ovs_interfaceid": "07ef7c80-642e-4806-a038-12f69714fa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a2b21901-57d0-4686-a358-9c95d34600d7 req-683eed8b-b822-46a3-b366-c6492bfc129c service nova] Releasing lock "refresh_cache-b8d3da3e-3927-4f4e-b9a3-994d45d5a408" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7fccd97-1d, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7fccd97-1d, col_values=(('qos', UUID('40d447c0-9d87-431b-85fe-5a21519cd93c')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7fccd97-1d, col_values=(('external_ids', {'iface-id': 'd7fccd97-1db7-4dac-b2e9-6d5b4004aa70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:3f:d4', 'vm-uuid': 'eb712362-b6b8-4a19-8f5b-8c374d6c4d87'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:38 user nova-compute[75018]: INFO os_vif [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d7fccd97-1db7-4dac-b2e9-6d5b4004aa70,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7fccd97-1d')
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05429ce8-06, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05429ce8-06, col_values=(('qos', UUID('dacdea2f-d9ff-4487-96fe-06b65d8d2954')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05429ce8-06, col_values=(('external_ids', {'iface-id': '05429ce8-06b2-4693-bf2c-5d03a4343e00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:52:2c', 'vm-uuid': '8257c590-204a-4fde-8487-79b8c0c87ea7'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:38 user nova-compute[75018]: INFO os_vif [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06')
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07ef7c80-64, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07ef7c80-64, col_values=(('qos', UUID('78cc2b3d-5225-4af3-b401-2d584d3c8fcb')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07ef7c80-64, col_values=(('external_ids', {'iface-id': '07ef7c80-642e-4806-a038-12f69714fa5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:c1:25', 'vm-uuid': 'b8d3da3e-3927-4f4e-b9a3-994d45d5a408'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] No VIF found with MAC fa:16:3e:be:3f:d4, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] No VIF found with MAC fa:16:3e:a6:52:2c, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:38 user nova-compute[75018]: INFO os_vif [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c1:25,bridge_name='br-int',has_traffic_filtering=True,id=07ef7c80-642e-4806-a038-12f69714fa5a,network=Network(895875dd-6ac7-4acf-ad8a-c03e8ae599e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ef7c80-64')
Nov 07 15:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:20:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] No VIF found with MAC fa:16:3e:e9:c1:25, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:20:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:44 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:20:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:20:44 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Instance spawned successfully.
Nov 07 15:20:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:20:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Instance spawned successfully.
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:20:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Instance spawned successfully.
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:45 user nova-compute[75018]: INFO nova.compute.manager [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Took 17.88 seconds to spawn the instance on the hypervisor.
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:20:45 user nova-compute[75018]: INFO nova.compute.manager [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Took 16.96 seconds to spawn the instance on the hypervisor.
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:20:45 user nova-compute[75018]: INFO nova.compute.manager [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Took 18.26 seconds to spawn the instance on the hypervisor.
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:20:45 user nova-compute[75018]: INFO nova.compute.manager [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Took 19.10 seconds to build instance.
Nov 07 15:20:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:45 user nova-compute[75018]: INFO nova.compute.manager [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Took 19.59 seconds to build instance.
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:20:45 user nova-compute[75018]: INFO nova.compute.manager [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Took 19.37 seconds to build instance.
Nov 07 15:20:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a224104a-db84-4d6b-aab2-f98e7008aea5 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.883s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2988d309-5c50-4e63-a190-eaf36727f3ec tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.974s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1ff33c3-4ea5-418f-a7ea-b1e3459d6727 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.406s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:20:45 user nova-compute[75018]: INFO nova.compute.claims [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Claim successful on node user
Nov 07 15:20:46 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG nova.compute.manager [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG nova.compute.manager [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG nova.network.neutron [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:20:46 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:20:46 user nova-compute[75018]: DEBUG nova.compute.manager [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG nova.policy [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d4b199a80014b9e8b931ee04376c693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fbe1a7764e40a3ba9fc1f02c183b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG nova.compute.manager [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:20:46 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Creating image(s)
Nov 07 15:20:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "/opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "/opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "/opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.026s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.337s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.235s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk 1073741824" returned: 0 in 0.070s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.294s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Cannot resize image /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Ensure instance console log exists: /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:20:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:48 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:20:48 user nova-compute[75018]: INFO nova.compute.claims [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Claim successful on node user
Nov 07 15:20:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:48 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:20:48 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:20:48 user nova-compute[75018]: DEBUG nova.network.neutron [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Successfully created port: 76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:20:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:48 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:20:48 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:20:48 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:20:48 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 07 15:20:48 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:20:49 user nova-compute[75018]: DEBUG nova.policy [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45c358e42fcc4d7887547c618f2f1b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878175ee02584bcbb6f34320413d5a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:20:49 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:20:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:20:49 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Creating image(s)
Nov 07 15:20:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "/opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "/opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "/opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "01345541bb3f34c21fba0fe1408a4fc36e885122" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "01345541bb3f34c21fba0fe1408a4fc36e885122" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122.part --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122.part --force-share --output=json" returned: 0 in 0.366s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:50 user nova-compute[75018]: DEBUG nova.virt.images [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] e1b28ccf-e7cd-45dd-81df-9dab2477d734 was qcow2, converting to raw {{(pid=75018) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 15:20:50 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:20:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122.part /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122.converted {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122.part /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122.converted" returned: 0 in 0.254s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122.converted --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122.converted --force-share --output=json" returned: 0 in 0.271s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "01345541bb3f34c21fba0fe1408a4fc36e885122" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.872s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122 --force-share --output=json" returned: 0 in 0.307s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG nova.network.neutron [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Successfully updated port: 76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "01345541bb3f34c21fba0fe1408a4fc36e885122" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "01345541bb3f34c21fba0fe1408a4fc36e885122" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.011s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "refresh_cache-811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquired lock "refresh_cache-811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG nova.network.neutron [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-b58d89c8-693f-4bd1-af79-c9bebdce0a7c req-b60afe96-bd86-45fd-aad2-c3271459a382 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Received event network-changed-76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-b58d89c8-693f-4bd1-af79-c9bebdce0a7c req-b60afe96-bd86-45fd-aad2-c3271459a382 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Refreshing instance network info cache due to event network-changed-76649643-812d-4246-873b-3209e1d13b85. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b58d89c8-693f-4bd1-af79-c9bebdce0a7c req-b60afe96-bd86-45fd-aad2-c3271459a382 service nova] Acquiring lock "refresh_cache-811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG nova.network.neutron [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122 --force-share --output=json" returned: 0 in 0.303s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122,backing_fmt=raw /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122,backing_fmt=raw /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk 1073741824" returned: 0 in 0.061s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "01345541bb3f34c21fba0fe1408a4fc36e885122" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.370s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122 --force-share --output=json" returned: 0 in 0.344s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Checking if we can resize image /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Cannot resize image /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Ensure instance console log exists: /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Updating instance_info_cache with network_info: [{"id": "76649643-812d-4246-873b-3209e1d13b85", "address": "fa:16:3e:77:19:09", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76649643-81", "ovs_interfaceid": "76649643-812d-4246-873b-3209e1d13b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Releasing lock "refresh_cache-811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Instance network_info: |[{"id": "76649643-812d-4246-873b-3209e1d13b85", "address": "fa:16:3e:77:19:09", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76649643-81", "ovs_interfaceid": "76649643-812d-4246-873b-3209e1d13b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b58d89c8-693f-4bd1-af79-c9bebdce0a7c req-b60afe96-bd86-45fd-aad2-c3271459a382 service nova] Acquired lock "refresh_cache-811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.network.neutron [req-b58d89c8-693f-4bd1-af79-c9bebdce0a7c req-b60afe96-bd86-45fd-aad2-c3271459a382 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Refreshing network info cache for port 76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Start _get_guest_xml network_info=[{"id": "76649643-812d-4246-873b-3209e1d13b85", "address": "fa:16:3e:77:19:09", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76649643-81", "ovs_interfaceid": "76649643-812d-4246-873b-3209e1d13b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:20:52 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:20:52 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-493910870',display_name='tempest-VolumesAdminNegativeTest-server-493910870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-493910870',id=4,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD0iGN68zs8Moz1E0eytcMxS7dagiQCYtH82O9sxDfLwZucC4K3K6iX4zsI4mfiGUxXcluZ9stk+cJchLAF3gtd7znSSNlrr8XczgvFIGCmybIM0baHWoY2bFzI+47kvA==',key_name='tempest-keypair-212283346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27fbe1a7764e40a3ba9fc1f02c183b50',ramdisk_id='',reservation_id='r-aus20dny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-617339332',owner_user_name='tempest-VolumesAdminNegativeTest-617339332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d4b199a80014b9e8b931ee04376c693',uuid=811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76649643-812d-4246-873b-3209e1d13b85", "address": "fa:16:3e:77:19:09", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76649643-81", "ovs_interfaceid": "76649643-812d-4246-873b-3209e1d13b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Converting VIF {"id": "76649643-812d-4246-873b-3209e1d13b85", "address": "fa:16:3e:77:19:09", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76649643-81", "ovs_interfaceid": "76649643-812d-4246-873b-3209e1d13b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:19:09,bridge_name='br-int',has_traffic_filtering=True,id=76649643-812d-4246-873b-3209e1d13b85,network=Network(fc935020-27d6-4ac8-9e8e-6fa65590da1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76649643-81') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.objects.instance [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lazy-loading 'pci_devices' on Instance uuid 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:20:52 user nova-compute[75018]:   <uuid>811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b</uuid>
Nov 07 15:20:52 user nova-compute[75018]:   <name>instance-00000004</name>
Nov 07 15:20:52 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:20:52 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:20:52 user nova-compute[75018]:   <metadata>
Nov 07 15:20:52 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:20:52 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:20:52 user nova-compute[75018]:       <nova:name>tempest-VolumesAdminNegativeTest-server-493910870</nova:name>
Nov 07 15:20:52 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:20:52</nova:creationTime>
Nov 07 15:20:52 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:20:52 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:20:52 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:20:52 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:20:52 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:20:52 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:20:52 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:20:52 user nova-compute[75018]:       <nova:owner>
Nov 07 15:20:52 user nova-compute[75018]:         <nova:user uuid="7d4b199a80014b9e8b931ee04376c693">tempest-VolumesAdminNegativeTest-617339332-project-member</nova:user>
Nov 07 15:20:52 user nova-compute[75018]:         <nova:project uuid="27fbe1a7764e40a3ba9fc1f02c183b50">tempest-VolumesAdminNegativeTest-617339332</nova:project>
Nov 07 15:20:52 user nova-compute[75018]:       </nova:owner>
Nov 07 15:20:52 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:20:52 user nova-compute[75018]:       <nova:ports>
Nov 07 15:20:52 user nova-compute[75018]:         <nova:port uuid="76649643-812d-4246-873b-3209e1d13b85">
Nov 07 15:20:52 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 07 15:20:52 user nova-compute[75018]:         </nova:port>
Nov 07 15:20:52 user nova-compute[75018]:       </nova:ports>
Nov 07 15:20:52 user nova-compute[75018]:     </nova:instance>
Nov 07 15:20:52 user nova-compute[75018]:   </metadata>
Nov 07 15:20:52 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:20:52 user nova-compute[75018]:     <system>
Nov 07 15:20:52 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:20:52 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:20:52 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:20:52 user nova-compute[75018]:       <entry name="serial">811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b</entry>
Nov 07 15:20:52 user nova-compute[75018]:       <entry name="uuid">811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b</entry>
Nov 07 15:20:52 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:20:52 user nova-compute[75018]:     </system>
Nov 07 15:20:52 user nova-compute[75018]:   </sysinfo>
Nov 07 15:20:52 user nova-compute[75018]:   <os>
Nov 07 15:20:52 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:20:52 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:20:52 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:20:52 user nova-compute[75018]:   </os>
Nov 07 15:20:52 user nova-compute[75018]:   <features>
Nov 07 15:20:52 user nova-compute[75018]:     <acpi/>
Nov 07 15:20:52 user nova-compute[75018]:     <apic/>
Nov 07 15:20:52 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:20:52 user nova-compute[75018]:   </features>
Nov 07 15:20:52 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:20:52 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:20:52 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:20:52 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:20:52 user nova-compute[75018]:   </clock>
Nov 07 15:20:52 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:20:52 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:20:52 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:20:52 user nova-compute[75018]:   </cpu>
Nov 07 15:20:52 user nova-compute[75018]:   <devices>
Nov 07 15:20:52 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:20:52 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:20:52 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk"/>
Nov 07 15:20:52 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:20:52 user nova-compute[75018]:     </disk>
Nov 07 15:20:52 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:20:52 user nova-compute[75018]:       <mac address="fa:16:3e:77:19:09"/>
Nov 07 15:20:52 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:20:52 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:20:52 user nova-compute[75018]:       <target dev="tap76649643-81"/>
Nov 07 15:20:52 user nova-compute[75018]:     </interface>
Nov 07 15:20:52 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:20:52 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/console.log" append="off"/>
Nov 07 15:20:52 user nova-compute[75018]:     </serial>
Nov 07 15:20:52 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:20:52 user nova-compute[75018]:     <video>
Nov 07 15:20:52 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:20:52 user nova-compute[75018]:     </video>
Nov 07 15:20:52 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:20:52 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:20:52 user nova-compute[75018]:     </rng>
Nov 07 15:20:52 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:20:52 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:20:52 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:20:52 user nova-compute[75018]:     </memballoon>
Nov 07 15:20:52 user nova-compute[75018]:   </devices>
Nov 07 15:20:52 user nova-compute[75018]: </domain>
Nov 07 15:20:52 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-493910870',display_name='tempest-VolumesAdminNegativeTest-server-493910870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-493910870',id=4,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD0iGN68zs8Moz1E0eytcMxS7dagiQCYtH82O9sxDfLwZucC4K3K6iX4zsI4mfiGUxXcluZ9stk+cJchLAF3gtd7znSSNlrr8XczgvFIGCmybIM0baHWoY2bFzI+47kvA==',key_name='tempest-keypair-212283346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27fbe1a7764e40a3ba9fc1f02c183b50',ramdisk_id='',reservation_id='r-aus20dny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-617339332',owner_user_name='tempest-VolumesAdminNegativeTest-617339332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d4b199a80014b9e8b931ee04376c693',uuid=811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76649643-812d-4246-873b-3209e1d13b85", "address": "fa:16:3e:77:19:09", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76649643-81", "ovs_interfaceid": "76649643-812d-4246-873b-3209e1d13b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Converting VIF {"id": "76649643-812d-4246-873b-3209e1d13b85", "address": "fa:16:3e:77:19:09", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76649643-81", "ovs_interfaceid": "76649643-812d-4246-873b-3209e1d13b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:19:09,bridge_name='br-int',has_traffic_filtering=True,id=76649643-812d-4246-873b-3209e1d13b85,network=Network(fc935020-27d6-4ac8-9e8e-6fa65590da1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76649643-81') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG os_vif [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:19:09,bridge_name='br-int',has_traffic_filtering=True,id=76649643-812d-4246-873b-3209e1d13b85,network=Network(fc935020-27d6-4ac8-9e8e-6fa65590da1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76649643-81') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5ed7e9c-efca-52b3-91e3-7b18676a4aa2', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76649643-81, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76649643-81, col_values=(('qos', UUID('10284e2e-7a0d-4589-b477-9e69a339574f')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76649643-81, col_values=(('external_ids', {'iface-id': '76649643-812d-4246-873b-3209e1d13b85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:19:09', 'vm-uuid': '811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:20:52 user nova-compute[75018]: INFO os_vif [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:19:09,bridge_name='br-int',has_traffic_filtering=True,id=76649643-812d-4246-873b-3209e1d13b85,network=Network(fc935020-27d6-4ac8-9e8e-6fa65590da1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76649643-81')
Nov 07 15:20:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Successfully created port: 4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:20:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:20:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] No VIF found with MAC fa:16:3e:77:19:09, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:20:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.network.neutron [req-b58d89c8-693f-4bd1-af79-c9bebdce0a7c req-b60afe96-bd86-45fd-aad2-c3271459a382 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Updated VIF entry in instance network info cache for port 76649643-812d-4246-873b-3209e1d13b85. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.network.neutron [req-b58d89c8-693f-4bd1-af79-c9bebdce0a7c req-b60afe96-bd86-45fd-aad2-c3271459a382 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Updating instance_info_cache with network_info: [{"id": "76649643-812d-4246-873b-3209e1d13b85", "address": "fa:16:3e:77:19:09", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76649643-81", "ovs_interfaceid": "76649643-812d-4246-873b-3209e1d13b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b58d89c8-693f-4bd1-af79-c9bebdce0a7c req-b60afe96-bd86-45fd-aad2-c3271459a382 service nova] Releasing lock "refresh_cache-811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Successfully updated port: 4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "refresh_cache-569b9815-efc4-46d0-832e-9931fdd7d6ad" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquired lock "refresh_cache-569b9815-efc4-46d0-832e-9931fdd7d6ad" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.compute.manager [req-bb1e3209-36ed-425d-af93-86770b65a2e1 req-234cec6a-51a5-4b15-8eab-126cfb2120ad service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Received event network-changed-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.compute.manager [req-bb1e3209-36ed-425d-af93-86770b65a2e1 req-234cec6a-51a5-4b15-8eab-126cfb2120ad service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Refreshing instance network info cache due to event network-changed-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-bb1e3209-36ed-425d-af93-86770b65a2e1 req-234cec6a-51a5-4b15-8eab-126cfb2120ad service nova] Acquiring lock "refresh_cache-569b9815-efc4-46d0-832e-9931fdd7d6ad" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Updating instance_info_cache with network_info: [{"id": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "address": "fa:16:3e:76:54:9c", "network": {"id": "4f26fb82-d023-4342-9035-8726850c06ad", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-819357445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "878175ee02584bcbb6f34320413d5a81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7ff3f5-f2", "ovs_interfaceid": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Releasing lock "refresh_cache-569b9815-efc4-46d0-832e-9931fdd7d6ad" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Instance network_info: |[{"id": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "address": "fa:16:3e:76:54:9c", "network": {"id": "4f26fb82-d023-4342-9035-8726850c06ad", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-819357445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "878175ee02584bcbb6f34320413d5a81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7ff3f5-f2", "ovs_interfaceid": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-bb1e3209-36ed-425d-af93-86770b65a2e1 req-234cec6a-51a5-4b15-8eab-126cfb2120ad service nova] Acquired lock "refresh_cache-569b9815-efc4-46d0-832e-9931fdd7d6ad" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.network.neutron [req-bb1e3209-36ed-425d-af93-86770b65a2e1 req-234cec6a-51a5-4b15-8eab-126cfb2120ad service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Refreshing network info cache for port 4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Start _get_guest_xml network_info=[{"id": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "address": "fa:16:3e:76:54:9c", "network": {"id": "4f26fb82-d023-4342-9035-8726850c06ad", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-819357445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "878175ee02584bcbb6f34320413d5a81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7ff3f5-f2", "ovs_interfaceid": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:20:40Z,direct_url=<?>,disk_format='qcow2',id=e1b28ccf-e7cd-45dd-81df-9dab2477d734,min_disk=0,min_ram=0,name='',owner='7dcf622578f744acb7a46eb63dea51ef',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:20:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'scsi', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'encrypted': False, 'image_id': 'e1b28ccf-e7cd-45dd-81df-9dab2477d734'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:20:54 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:20:54 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:20:40Z,direct_url=<?>,disk_format='qcow2',id=e1b28ccf-e7cd-45dd-81df-9dab2477d734,min_disk=0,min_ram=0,name='',owner='7dcf622578f744acb7a46eb63dea51ef',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:20:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-99590872',display_name='tempest-AttachSCSIVolumeTestJSON-server-99590872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-99590872',id=5,image_ref='e1b28ccf-e7cd-45dd-81df-9dab2477d734',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKz0MrEODXkanaLZBHd3BrUzyWVW0EkImodtIWTOz63VIychSim/6j80u86aPhZKoB6yreySnaVpM93820MdZ4Ao6iRJUrBln1pJ1kCgmtqyvLbl6s2oub95EvyNZSwyTg==',key_name='tempest-keypair-93251947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='878175ee02584bcbb6f34320413d5a81',ramdisk_id='',reservation_id='r-bjem0jvv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e1b28ccf-e7cd-45dd-81df-9dab2477d734',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1990932830',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1990932830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45c358e42fcc4d7887547c618f2f1b43',uuid=569b9815-efc4-46d0-832e-9931fdd7d6ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "address": "fa:16:3e:76:54:9c", "network": {"id": "4f26fb82-d023-4342-9035-8726850c06ad", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-819357445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "878175ee02584bcbb6f34320413d5a81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7ff3f5-f2", "ovs_interfaceid": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Converting VIF {"id": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "address": "fa:16:3e:76:54:9c", "network": {"id": "4f26fb82-d023-4342-9035-8726850c06ad", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-819357445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "878175ee02584bcbb6f34320413d5a81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7ff3f5-f2", "ovs_interfaceid": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:54:9c,bridge_name='br-int',has_traffic_filtering=True,id=4b7ff3f5-f222-4af3-905a-acb2ebef3aa9,network=Network(4f26fb82-d023-4342-9035-8726850c06ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7ff3f5-f2') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.objects.instance [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lazy-loading 'pci_devices' on Instance uuid 569b9815-efc4-46d0-832e-9931fdd7d6ad {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:20:54 user nova-compute[75018]:   <uuid>569b9815-efc4-46d0-832e-9931fdd7d6ad</uuid>
Nov 07 15:20:54 user nova-compute[75018]:   <name>instance-00000005</name>
Nov 07 15:20:54 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:20:54 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:20:54 user nova-compute[75018]:   <metadata>
Nov 07 15:20:54 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:20:54 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:20:54 user nova-compute[75018]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-99590872</nova:name>
Nov 07 15:20:54 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:20:54</nova:creationTime>
Nov 07 15:20:54 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:20:54 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:20:54 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:20:54 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:20:54 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:20:54 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:20:54 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:20:54 user nova-compute[75018]:       <nova:owner>
Nov 07 15:20:54 user nova-compute[75018]:         <nova:user uuid="45c358e42fcc4d7887547c618f2f1b43">tempest-AttachSCSIVolumeTestJSON-1990932830-project-member</nova:user>
Nov 07 15:20:54 user nova-compute[75018]:         <nova:project uuid="878175ee02584bcbb6f34320413d5a81">tempest-AttachSCSIVolumeTestJSON-1990932830</nova:project>
Nov 07 15:20:54 user nova-compute[75018]:       </nova:owner>
Nov 07 15:20:54 user nova-compute[75018]:       <nova:root type="image" uuid="e1b28ccf-e7cd-45dd-81df-9dab2477d734"/>
Nov 07 15:20:54 user nova-compute[75018]:       <nova:ports>
Nov 07 15:20:54 user nova-compute[75018]:         <nova:port uuid="4b7ff3f5-f222-4af3-905a-acb2ebef3aa9">
Nov 07 15:20:54 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 07 15:20:54 user nova-compute[75018]:         </nova:port>
Nov 07 15:20:54 user nova-compute[75018]:       </nova:ports>
Nov 07 15:20:54 user nova-compute[75018]:     </nova:instance>
Nov 07 15:20:54 user nova-compute[75018]:   </metadata>
Nov 07 15:20:54 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:20:54 user nova-compute[75018]:     <system>
Nov 07 15:20:54 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:20:54 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:20:54 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:20:54 user nova-compute[75018]:       <entry name="serial">569b9815-efc4-46d0-832e-9931fdd7d6ad</entry>
Nov 07 15:20:54 user nova-compute[75018]:       <entry name="uuid">569b9815-efc4-46d0-832e-9931fdd7d6ad</entry>
Nov 07 15:20:54 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:20:54 user nova-compute[75018]:     </system>
Nov 07 15:20:54 user nova-compute[75018]:   </sysinfo>
Nov 07 15:20:54 user nova-compute[75018]:   <os>
Nov 07 15:20:54 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:20:54 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:20:54 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:20:54 user nova-compute[75018]:   </os>
Nov 07 15:20:54 user nova-compute[75018]:   <features>
Nov 07 15:20:54 user nova-compute[75018]:     <acpi/>
Nov 07 15:20:54 user nova-compute[75018]:     <apic/>
Nov 07 15:20:54 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:20:54 user nova-compute[75018]:   </features>
Nov 07 15:20:54 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:20:54 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:20:54 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:20:54 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:20:54 user nova-compute[75018]:   </clock>
Nov 07 15:20:54 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:20:54 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:20:54 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:20:54 user nova-compute[75018]:   </cpu>
Nov 07 15:20:54 user nova-compute[75018]:   <devices>
Nov 07 15:20:54 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:20:54 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:20:54 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk"/>
Nov 07 15:20:54 user nova-compute[75018]:       <target dev="sda" bus="scsi"/>
Nov 07 15:20:54 user nova-compute[75018]:       <address type="drive" controller="0" unit="0"/>
Nov 07 15:20:54 user nova-compute[75018]:     </disk>
Nov 07 15:20:54 user nova-compute[75018]:     <disk type="file" device="cdrom">
Nov 07 15:20:54 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none"/>
Nov 07 15:20:54 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk.config"/>
Nov 07 15:20:54 user nova-compute[75018]:       <target dev="sdb" bus="scsi"/>
Nov 07 15:20:54 user nova-compute[75018]:       <address type="drive" controller="0" unit="1"/>
Nov 07 15:20:54 user nova-compute[75018]:     </disk>
Nov 07 15:20:54 user nova-compute[75018]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 07 15:20:54 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:20:54 user nova-compute[75018]:       <mac address="fa:16:3e:76:54:9c"/>
Nov 07 15:20:54 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:20:54 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:20:54 user nova-compute[75018]:       <target dev="tap4b7ff3f5-f2"/>
Nov 07 15:20:54 user nova-compute[75018]:     </interface>
Nov 07 15:20:54 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:20:54 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/console.log" append="off"/>
Nov 07 15:20:54 user nova-compute[75018]:     </serial>
Nov 07 15:20:54 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:20:54 user nova-compute[75018]:     <video>
Nov 07 15:20:54 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:20:54 user nova-compute[75018]:     </video>
Nov 07 15:20:54 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:20:54 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:20:54 user nova-compute[75018]:     </rng>
Nov 07 15:20:54 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:20:54 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:20:54 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:20:54 user nova-compute[75018]:     </memballoon>
Nov 07 15:20:54 user nova-compute[75018]:   </devices>
Nov 07 15:20:54 user nova-compute[75018]: </domain>
Nov 07 15:20:54 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-99590872',display_name='tempest-AttachSCSIVolumeTestJSON-server-99590872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-99590872',id=5,image_ref='e1b28ccf-e7cd-45dd-81df-9dab2477d734',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKz0MrEODXkanaLZBHd3BrUzyWVW0EkImodtIWTOz63VIychSim/6j80u86aPhZKoB6yreySnaVpM93820MdZ4Ao6iRJUrBln1pJ1kCgmtqyvLbl6s2oub95EvyNZSwyTg==',key_name='tempest-keypair-93251947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='878175ee02584bcbb6f34320413d5a81',ramdisk_id='',reservation_id='r-bjem0jvv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e1b28ccf-e7cd-45dd-81df-9dab2477d734',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1990932830',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1990932830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45c358e42fcc4d7887547c618f2f1b43',uuid=569b9815-efc4-46d0-832e-9931fdd7d6ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "address": "fa:16:3e:76:54:9c", "network": {"id": "4f26fb82-d023-4342-9035-8726850c06ad", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-819357445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "878175ee02584bcbb6f34320413d5a81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7ff3f5-f2", "ovs_interfaceid": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Converting VIF {"id": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "address": "fa:16:3e:76:54:9c", "network": {"id": "4f26fb82-d023-4342-9035-8726850c06ad", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-819357445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "878175ee02584bcbb6f34320413d5a81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7ff3f5-f2", "ovs_interfaceid": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:54:9c,bridge_name='br-int',has_traffic_filtering=True,id=4b7ff3f5-f222-4af3-905a-acb2ebef3aa9,network=Network(4f26fb82-d023-4342-9035-8726850c06ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7ff3f5-f2') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG os_vif [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:54:9c,bridge_name='br-int',has_traffic_filtering=True,id=4b7ff3f5-f222-4af3-905a-acb2ebef3aa9,network=Network(4f26fb82-d023-4342-9035-8726850c06ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7ff3f5-f2') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12ba24c1-179f-53ed-a8ee-6bf37ae90985', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b7ff3f5-f2, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b7ff3f5-f2, col_values=(('qos', UUID('d10403ea-12bd-4d6a-84f6-f3825806e3ce')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b7ff3f5-f2, col_values=(('external_ids', {'iface-id': '4b7ff3f5-f222-4af3-905a-acb2ebef3aa9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:54:9c', 'vm-uuid': '569b9815-efc4-46d0-832e-9931fdd7d6ad'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:20:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:20:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:55 user nova-compute[75018]: INFO os_vif [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:54:9c,bridge_name='br-int',has_traffic_filtering=True,id=4b7ff3f5-f222-4af3-905a-acb2ebef3aa9,network=Network(4f26fb82-d023-4342-9035-8726850c06ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7ff3f5-f2')
Nov 07 15:20:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] No BDM found with device name sda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:20:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:20:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] No VIF found with MAC fa:16:3e:76:54:9c, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:20:55 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Using config drive
Nov 07 15:20:55 user nova-compute[75018]: DEBUG nova.network.neutron [req-bb1e3209-36ed-425d-af93-86770b65a2e1 req-234cec6a-51a5-4b15-8eab-126cfb2120ad service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Updated VIF entry in instance network info cache for port 4b7ff3f5-f222-4af3-905a-acb2ebef3aa9. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:20:55 user nova-compute[75018]: DEBUG nova.network.neutron [req-bb1e3209-36ed-425d-af93-86770b65a2e1 req-234cec6a-51a5-4b15-8eab-126cfb2120ad service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Updating instance_info_cache with network_info: [{"id": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "address": "fa:16:3e:76:54:9c", "network": {"id": "4f26fb82-d023-4342-9035-8726850c06ad", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-819357445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "878175ee02584bcbb6f34320413d5a81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7ff3f5-f2", "ovs_interfaceid": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:20:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-bb1e3209-36ed-425d-af93-86770b65a2e1 req-234cec6a-51a5-4b15-8eab-126cfb2120ad service nova] Releasing lock "refresh_cache-569b9815-efc4-46d0-832e-9931fdd7d6ad" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:20:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:55 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Creating config drive at /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk.config
Nov 07 15:20:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprez773uk {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprez773uk" returned: 0 in 0.091s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG nova.compute.manager [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG nova.compute.manager [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:20:57 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Instance spawned successfully.
Nov 07 15:20:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:20:57 user nova-compute[75018]: INFO nova.compute.claims [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Claim successful on node user
Nov 07 15:20:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:20:58 user nova-compute[75018]: INFO nova.compute.manager [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Took 11.50 seconds to spawn the instance on the hypervisor.
Nov 07 15:20:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:20:58 user nova-compute[75018]: INFO nova.compute.manager [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Took 12.69 seconds to build instance.
Nov 07 15:20:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-277633c2-2eaf-4c06-bb23-3940b144a339 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.907s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:58 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:20:58 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:20:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.785s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:20:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:20:58 user nova-compute[75018]: DEBUG nova.network.neutron [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:20:58 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:20:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG nova.compute.manager [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:20:59 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Creating image(s)
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG nova.policy [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8dd118649a4241bb95956240a2393048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c9868af5b9d4666b842470b30e169d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.278s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.287s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk 1073741824" returned: 0 in 0.105s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-8c83cdbf-633b-4d78-9ba1-c1b53eb84ab3 req-e0235db3-e244-42da-affa-827aa7587a6d service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received event network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8c83cdbf-633b-4d78-9ba1-c1b53eb84ab3 req-e0235db3-e244-42da-affa-827aa7587a6d service nova] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8c83cdbf-633b-4d78-9ba1-c1b53eb84ab3 req-e0235db3-e244-42da-affa-827aa7587a6d service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8c83cdbf-633b-4d78-9ba1-c1b53eb84ab3 req-e0235db3-e244-42da-affa-827aa7587a6d service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-8c83cdbf-633b-4d78-9ba1-c1b53eb84ab3 req-e0235db3-e244-42da-affa-827aa7587a6d service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] No waiting events found dispatching network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:20:59 user nova-compute[75018]: WARNING nova.compute.manager [req-8c83cdbf-633b-4d78-9ba1-c1b53eb84ab3 req-e0235db3-e244-42da-affa-827aa7587a6d service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received unexpected event network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 for instance with vm_state active and task_state None.
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.409s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.212s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:20:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:00 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Cannot resize image /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:21:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:21:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Ensure instance console log exists: /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:21:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:21:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:21:00 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Instance spawned successfully.
Nov 07 15:21:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:21:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:00 user nova-compute[75018]: INFO nova.compute.manager [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Took 11.40 seconds to spawn the instance on the hypervisor.
Nov 07 15:21:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:21:00 user nova-compute[75018]: INFO nova.compute.manager [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Took 12.61 seconds to build instance.
Nov 07 15:21:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fafaeace-30c8-4257-8c93-61964fc80c98 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.991s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:00 user nova-compute[75018]: DEBUG nova.network.neutron [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Successfully created port: 5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received event network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] No waiting events found dispatching network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:01 user nova-compute[75018]: WARNING nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received unexpected event network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 for instance with vm_state active and task_state None.
Nov 07 15:21:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] No waiting events found dispatching network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:01 user nova-compute[75018]: WARNING nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received unexpected event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 for instance with vm_state active and task_state None.
Nov 07 15:21:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] No waiting events found dispatching network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:01 user nova-compute[75018]: WARNING nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received unexpected event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 for instance with vm_state active and task_state None.
Nov 07 15:21:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Received event network-vif-plugged-07ef7c80-642e-4806-a038-12f69714fa5a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Acquiring lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] No waiting events found dispatching network-vif-plugged-07ef7c80-642e-4806-a038-12f69714fa5a {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:01 user nova-compute[75018]: WARNING nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Received unexpected event network-vif-plugged-07ef7c80-642e-4806-a038-12f69714fa5a for instance with vm_state active and task_state None.
Nov 07 15:21:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Received event network-vif-plugged-07ef7c80-642e-4806-a038-12f69714fa5a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Acquiring lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] No waiting events found dispatching network-vif-plugged-07ef7c80-642e-4806-a038-12f69714fa5a {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:01 user nova-compute[75018]: WARNING nova.compute.manager [req-48fca7aa-6d8a-4d38-813d-f0b0be0b29e2 req-dd35a4c5-07bd-4cc3-a613-aa7528c82060 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Received unexpected event network-vif-plugged-07ef7c80-642e-4806-a038-12f69714fa5a for instance with vm_state active and task_state None.
Nov 07 15:21:02 user nova-compute[75018]: DEBUG nova.network.neutron [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Successfully updated port: 5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:21:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:21:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquired lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:21:02 user nova-compute[75018]: DEBUG nova.network.neutron [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:21:02 user nova-compute[75018]: DEBUG nova.network.neutron [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.network.neutron [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Updating instance_info_cache with network_info: [{"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Releasing lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.compute.manager [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Instance network_info: |[{"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Start _get_guest_xml network_info=[{"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:21:03 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:21:03 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1580286647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1580286647',id=6,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBa2umF2j3NFcrA/MMVfFX9CwszOvYSV953cPLJB8Fg9xF6mpuVYI1nrRM/8pACoITM+FQT+M6FG3/0v9UsQ2UUg5VLULbr4xVkSLj0F171iDoJzrj+ppTAogqlmzzug==',key_name='tempest-keypair-464082042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9868af5b9d4666b842470b30e169d2',ramdisk_id='',reservation_id='r-tw13f7f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2013364869',owner_user_name='tempest-TaggedAttachmentsTest-2013364869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd118649a4241bb95956240a2393048',uuid=f9efb536-b47e-4e87-bc54-fdf69cacf8e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Converting VIF {"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:55:2d,bridge_name='br-int',has_traffic_filtering=True,id=5b3da5d6-6cee-4668-b7cd-5d328309eca6,network=Network(1a48b985-929f-4749-a055-0c7c9f5d14db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b3da5d6-6c') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.objects.instance [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lazy-loading 'pci_devices' on Instance uuid f9efb536-b47e-4e87-bc54-fdf69cacf8e3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:21:03 user nova-compute[75018]:   <uuid>f9efb536-b47e-4e87-bc54-fdf69cacf8e3</uuid>
Nov 07 15:21:03 user nova-compute[75018]:   <name>instance-00000006</name>
Nov 07 15:21:03 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:21:03 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:21:03 user nova-compute[75018]:   <metadata>
Nov 07 15:21:03 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:21:03 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:21:03 user nova-compute[75018]:       <nova:name>tempest-device-tagging-server-1580286647</nova:name>
Nov 07 15:21:03 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:21:03</nova:creationTime>
Nov 07 15:21:03 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:21:03 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:21:03 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:21:03 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:21:03 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:21:03 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:21:03 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:21:03 user nova-compute[75018]:       <nova:owner>
Nov 07 15:21:03 user nova-compute[75018]:         <nova:user uuid="8dd118649a4241bb95956240a2393048">tempest-TaggedAttachmentsTest-2013364869-project-member</nova:user>
Nov 07 15:21:03 user nova-compute[75018]:         <nova:project uuid="5c9868af5b9d4666b842470b30e169d2">tempest-TaggedAttachmentsTest-2013364869</nova:project>
Nov 07 15:21:03 user nova-compute[75018]:       </nova:owner>
Nov 07 15:21:03 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:21:03 user nova-compute[75018]:       <nova:ports>
Nov 07 15:21:03 user nova-compute[75018]:         <nova:port uuid="5b3da5d6-6cee-4668-b7cd-5d328309eca6">
Nov 07 15:21:03 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 07 15:21:03 user nova-compute[75018]:         </nova:port>
Nov 07 15:21:03 user nova-compute[75018]:       </nova:ports>
Nov 07 15:21:03 user nova-compute[75018]:     </nova:instance>
Nov 07 15:21:03 user nova-compute[75018]:   </metadata>
Nov 07 15:21:03 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:21:03 user nova-compute[75018]:     <system>
Nov 07 15:21:03 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:21:03 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:21:03 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:21:03 user nova-compute[75018]:       <entry name="serial">f9efb536-b47e-4e87-bc54-fdf69cacf8e3</entry>
Nov 07 15:21:03 user nova-compute[75018]:       <entry name="uuid">f9efb536-b47e-4e87-bc54-fdf69cacf8e3</entry>
Nov 07 15:21:03 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:21:03 user nova-compute[75018]:     </system>
Nov 07 15:21:03 user nova-compute[75018]:   </sysinfo>
Nov 07 15:21:03 user nova-compute[75018]:   <os>
Nov 07 15:21:03 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:21:03 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:21:03 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:21:03 user nova-compute[75018]:   </os>
Nov 07 15:21:03 user nova-compute[75018]:   <features>
Nov 07 15:21:03 user nova-compute[75018]:     <acpi/>
Nov 07 15:21:03 user nova-compute[75018]:     <apic/>
Nov 07 15:21:03 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:21:03 user nova-compute[75018]:   </features>
Nov 07 15:21:03 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:21:03 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:21:03 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:21:03 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:21:03 user nova-compute[75018]:   </clock>
Nov 07 15:21:03 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:21:03 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:21:03 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:21:03 user nova-compute[75018]:   </cpu>
Nov 07 15:21:03 user nova-compute[75018]:   <devices>
Nov 07 15:21:03 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:21:03 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:21:03 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk"/>
Nov 07 15:21:03 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:21:03 user nova-compute[75018]:     </disk>
Nov 07 15:21:03 user nova-compute[75018]:     <disk type="file" device="cdrom">
Nov 07 15:21:03 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none"/>
Nov 07 15:21:03 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk.config"/>
Nov 07 15:21:03 user nova-compute[75018]:       <target dev="hda" bus="ide"/>
Nov 07 15:21:03 user nova-compute[75018]:     </disk>
Nov 07 15:21:03 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:21:03 user nova-compute[75018]:       <mac address="fa:16:3e:e1:55:2d"/>
Nov 07 15:21:03 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:21:03 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:21:03 user nova-compute[75018]:       <target dev="tap5b3da5d6-6c"/>
Nov 07 15:21:03 user nova-compute[75018]:     </interface>
Nov 07 15:21:03 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:21:03 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/console.log" append="off"/>
Nov 07 15:21:03 user nova-compute[75018]:     </serial>
Nov 07 15:21:03 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:21:03 user nova-compute[75018]:     <video>
Nov 07 15:21:03 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:21:03 user nova-compute[75018]:     </video>
Nov 07 15:21:03 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:21:03 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:21:03 user nova-compute[75018]:     </rng>
Nov 07 15:21:03 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:21:03 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:21:03 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:21:03 user nova-compute[75018]:     </memballoon>
Nov 07 15:21:03 user nova-compute[75018]:   </devices>
Nov 07 15:21:03 user nova-compute[75018]: </domain>
Nov 07 15:21:03 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1580286647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1580286647',id=6,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBa2umF2j3NFcrA/MMVfFX9CwszOvYSV953cPLJB8Fg9xF6mpuVYI1nrRM/8pACoITM+FQT+M6FG3/0v9UsQ2UUg5VLULbr4xVkSLj0F171iDoJzrj+ppTAogqlmzzug==',key_name='tempest-keypair-464082042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9868af5b9d4666b842470b30e169d2',ramdisk_id='',reservation_id='r-tw13f7f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2013364869',owner_user_name='tempest-TaggedAttachmentsTest-2013364869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd118649a4241bb95956240a2393048',uuid=f9efb536-b47e-4e87-bc54-fdf69cacf8e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Converting VIF {"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:55:2d,bridge_name='br-int',has_traffic_filtering=True,id=5b3da5d6-6cee-4668-b7cd-5d328309eca6,network=Network(1a48b985-929f-4749-a055-0c7c9f5d14db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b3da5d6-6c') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG os_vif [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:55:2d,bridge_name='br-int',has_traffic_filtering=True,id=5b3da5d6-6cee-4668-b7cd-5d328309eca6,network=Network(1a48b985-929f-4749-a055-0c7c9f5d14db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b3da5d6-6c') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd03ec98-a4ba-56a0-9b74-695be4648be2', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b3da5d6-6c, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b3da5d6-6c, col_values=(('qos', UUID('2526cd3c-3e8e-40d8-8fe5-feb6b7a77108')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b3da5d6-6c, col_values=(('external_ids', {'iface-id': '5b3da5d6-6cee-4668-b7cd-5d328309eca6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:55:2d', 'vm-uuid': 'f9efb536-b47e-4e87-bc54-fdf69cacf8e3'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:03 user nova-compute[75018]: INFO os_vif [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:55:2d,bridge_name='br-int',has_traffic_filtering=True,id=5b3da5d6-6cee-4668-b7cd-5d328309eca6,network=Network(1a48b985-929f-4749-a055-0c7c9f5d14db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b3da5d6-6c')
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] No BDM found with device name hda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] No VIF found with MAC fa:16:3e:e1:55:2d, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:21:03 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Using config drive
Nov 07 15:21:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-9e9ca255-e0e0-448b-9991-a382faacd31b req-d07f818e-c840-4988-b212-dc0458ab89b2 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received event network-changed-5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-9e9ca255-e0e0-448b-9991-a382faacd31b req-d07f818e-c840-4988-b212-dc0458ab89b2 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Refreshing instance network info cache due to event network-changed-5b3da5d6-6cee-4668-b7cd-5d328309eca6. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9e9ca255-e0e0-448b-9991-a382faacd31b req-d07f818e-c840-4988-b212-dc0458ab89b2 service nova] Acquiring lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9e9ca255-e0e0-448b-9991-a382faacd31b req-d07f818e-c840-4988-b212-dc0458ab89b2 service nova] Acquired lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.network.neutron [req-9e9ca255-e0e0-448b-9991-a382faacd31b req-d07f818e-c840-4988-b212-dc0458ab89b2 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Refreshing network info cache for port 5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:21:03 user nova-compute[75018]: INFO nova.compute.claims [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Claim successful on node user
Nov 07 15:21:04 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Creating config drive at /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk.config
Nov 07 15:21:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeqcmuool {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeqcmuool" returned: 0 in 0.051s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG nova.network.neutron [req-9e9ca255-e0e0-448b-9991-a382faacd31b req-d07f818e-c840-4988-b212-dc0458ab89b2 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Updated VIF entry in instance network info cache for port 5b3da5d6-6cee-4668-b7cd-5d328309eca6. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG nova.network.neutron [req-9e9ca255-e0e0-448b-9991-a382faacd31b req-d07f818e-c840-4988-b212-dc0458ab89b2 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Updating instance_info_cache with network_info: [{"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9e9ca255-e0e0-448b-9991-a382faacd31b req-d07f818e-c840-4988-b212-dc0458ab89b2 service nova] Releasing lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:21:04 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:21:04 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG nova.policy [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4107576c74842e7a92d18ec13934dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb79fc8bbc746178042b24a9019665c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:21:04 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Creating image(s)
Nov 07 15:21:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "/opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "/opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.214s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.202s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk 1073741824" returned: 0 in 0.069s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.238s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Successfully created port: cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Cannot resize image /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Ensure instance console log exists: /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Successfully updated port: cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "refresh_cache-e3abd70e-baf7-4f13-832c-43696a5ea80c" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquired lock "refresh_cache-e3abd70e-baf7-4f13-832c-43696a5ea80c" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.compute.manager [req-9376b7a4-3676-4e71-9240-329fd5196ce1 req-f9f3c497-4447-4782-9ff0-e14d9f41858f service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Received event network-changed-cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.compute.manager [req-9376b7a4-3676-4e71-9240-329fd5196ce1 req-f9f3c497-4447-4782-9ff0-e14d9f41858f service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Refreshing instance network info cache due to event network-changed-cd50d84f-cf19-4b67-a73a-12005d5f5078. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9376b7a4-3676-4e71-9240-329fd5196ce1 req-f9f3c497-4447-4782-9ff0-e14d9f41858f service nova] Acquiring lock "refresh_cache-e3abd70e-baf7-4f13-832c-43696a5ea80c" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Updating instance_info_cache with network_info: [{"id": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "address": "fa:16:3e:0f:01:77", "network": {"id": "e5c35126-c724-438d-ac83-88c7304a8c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-84841748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beb79fc8bbc746178042b24a9019665c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd50d84f-cf", "ovs_interfaceid": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Releasing lock "refresh_cache-e3abd70e-baf7-4f13-832c-43696a5ea80c" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Instance network_info: |[{"id": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "address": "fa:16:3e:0f:01:77", "network": {"id": "e5c35126-c724-438d-ac83-88c7304a8c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-84841748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beb79fc8bbc746178042b24a9019665c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd50d84f-cf", "ovs_interfaceid": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9376b7a4-3676-4e71-9240-329fd5196ce1 req-f9f3c497-4447-4782-9ff0-e14d9f41858f service nova] Acquired lock "refresh_cache-e3abd70e-baf7-4f13-832c-43696a5ea80c" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.network.neutron [req-9376b7a4-3676-4e71-9240-329fd5196ce1 req-f9f3c497-4447-4782-9ff0-e14d9f41858f service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Refreshing network info cache for port cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Start _get_guest_xml network_info=[{"id": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "address": "fa:16:3e:0f:01:77", "network": {"id": "e5c35126-c724-438d-ac83-88c7304a8c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-84841748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beb79fc8bbc746178042b24a9019665c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd50d84f-cf", "ovs_interfaceid": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:21:06 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:21:06 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1751161907',display_name='tempest-TestVolumeSwap-server-1751161907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1751161907',id=7,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITOH4b3sJIDcUHcfoLD5tN6lQPiucD3BzQ+uUXRzOqXJy6ipG8LChx6BbgI7qpI8rUdH115x8uVeyF9/2DZlviV8Ts9812hACqANOPlRsBqllHqeAUj3iz3Yn+5BuckiA==',key_name='tempest-keypair-1641892794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beb79fc8bbc746178042b24a9019665c',ramdisk_id='',reservation_id='r-w0jqsgvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-908466595',owner_user_name='tempest-TestVolumeSwap-908466595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4107576c74842e7a92d18ec13934dc7',uuid=e3abd70e-baf7-4f13-832c-43696a5ea80c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "address": "fa:16:3e:0f:01:77", "network": {"id": "e5c35126-c724-438d-ac83-88c7304a8c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-84841748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beb79fc8bbc746178042b24a9019665c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd50d84f-cf", "ovs_interfaceid": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Converting VIF {"id": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "address": "fa:16:3e:0f:01:77", "network": {"id": "e5c35126-c724-438d-ac83-88c7304a8c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-84841748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beb79fc8bbc746178042b24a9019665c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd50d84f-cf", "ovs_interfaceid": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:01:77,bridge_name='br-int',has_traffic_filtering=True,id=cd50d84f-cf19-4b67-a73a-12005d5f5078,network=Network(e5c35126-c724-438d-ac83-88c7304a8c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd50d84f-cf') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.objects.instance [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lazy-loading 'pci_devices' on Instance uuid e3abd70e-baf7-4f13-832c-43696a5ea80c {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:21:06 user nova-compute[75018]:   <uuid>e3abd70e-baf7-4f13-832c-43696a5ea80c</uuid>
Nov 07 15:21:06 user nova-compute[75018]:   <name>instance-00000007</name>
Nov 07 15:21:06 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:21:06 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:21:06 user nova-compute[75018]:   <metadata>
Nov 07 15:21:06 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:21:06 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:21:06 user nova-compute[75018]:       <nova:name>tempest-TestVolumeSwap-server-1751161907</nova:name>
Nov 07 15:21:06 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:21:06</nova:creationTime>
Nov 07 15:21:06 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:21:06 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:21:06 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:21:06 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:21:06 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:21:06 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:21:06 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:21:06 user nova-compute[75018]:       <nova:owner>
Nov 07 15:21:06 user nova-compute[75018]:         <nova:user uuid="f4107576c74842e7a92d18ec13934dc7">tempest-TestVolumeSwap-908466595-project-member</nova:user>
Nov 07 15:21:06 user nova-compute[75018]:         <nova:project uuid="beb79fc8bbc746178042b24a9019665c">tempest-TestVolumeSwap-908466595</nova:project>
Nov 07 15:21:06 user nova-compute[75018]:       </nova:owner>
Nov 07 15:21:06 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:21:06 user nova-compute[75018]:       <nova:ports>
Nov 07 15:21:06 user nova-compute[75018]:         <nova:port uuid="cd50d84f-cf19-4b67-a73a-12005d5f5078">
Nov 07 15:21:06 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 07 15:21:06 user nova-compute[75018]:         </nova:port>
Nov 07 15:21:06 user nova-compute[75018]:       </nova:ports>
Nov 07 15:21:06 user nova-compute[75018]:     </nova:instance>
Nov 07 15:21:06 user nova-compute[75018]:   </metadata>
Nov 07 15:21:06 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:21:06 user nova-compute[75018]:     <system>
Nov 07 15:21:06 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:21:06 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:21:06 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:21:06 user nova-compute[75018]:       <entry name="serial">e3abd70e-baf7-4f13-832c-43696a5ea80c</entry>
Nov 07 15:21:06 user nova-compute[75018]:       <entry name="uuid">e3abd70e-baf7-4f13-832c-43696a5ea80c</entry>
Nov 07 15:21:06 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:21:06 user nova-compute[75018]:     </system>
Nov 07 15:21:06 user nova-compute[75018]:   </sysinfo>
Nov 07 15:21:06 user nova-compute[75018]:   <os>
Nov 07 15:21:06 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:21:06 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:21:06 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:21:06 user nova-compute[75018]:   </os>
Nov 07 15:21:06 user nova-compute[75018]:   <features>
Nov 07 15:21:06 user nova-compute[75018]:     <acpi/>
Nov 07 15:21:06 user nova-compute[75018]:     <apic/>
Nov 07 15:21:06 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:21:06 user nova-compute[75018]:   </features>
Nov 07 15:21:06 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:21:06 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:21:06 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:21:06 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:21:06 user nova-compute[75018]:   </clock>
Nov 07 15:21:06 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:21:06 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:21:06 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:21:06 user nova-compute[75018]:   </cpu>
Nov 07 15:21:06 user nova-compute[75018]:   <devices>
Nov 07 15:21:06 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:21:06 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:21:06 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk"/>
Nov 07 15:21:06 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:21:06 user nova-compute[75018]:     </disk>
Nov 07 15:21:06 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:21:06 user nova-compute[75018]:       <mac address="fa:16:3e:0f:01:77"/>
Nov 07 15:21:06 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:21:06 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:21:06 user nova-compute[75018]:       <target dev="tapcd50d84f-cf"/>
Nov 07 15:21:06 user nova-compute[75018]:     </interface>
Nov 07 15:21:06 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:21:06 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/console.log" append="off"/>
Nov 07 15:21:06 user nova-compute[75018]:     </serial>
Nov 07 15:21:06 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:21:06 user nova-compute[75018]:     <video>
Nov 07 15:21:06 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:21:06 user nova-compute[75018]:     </video>
Nov 07 15:21:06 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:21:06 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:21:06 user nova-compute[75018]:     </rng>
Nov 07 15:21:06 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:21:06 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:21:06 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:21:06 user nova-compute[75018]:     </memballoon>
Nov 07 15:21:06 user nova-compute[75018]:   </devices>
Nov 07 15:21:06 user nova-compute[75018]: </domain>
Nov 07 15:21:06 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1751161907',display_name='tempest-TestVolumeSwap-server-1751161907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1751161907',id=7,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITOH4b3sJIDcUHcfoLD5tN6lQPiucD3BzQ+uUXRzOqXJy6ipG8LChx6BbgI7qpI8rUdH115x8uVeyF9/2DZlviV8Ts9812hACqANOPlRsBqllHqeAUj3iz3Yn+5BuckiA==',key_name='tempest-keypair-1641892794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beb79fc8bbc746178042b24a9019665c',ramdisk_id='',reservation_id='r-w0jqsgvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-908466595',owner_user_name='tempest-TestVolumeSwap-908466595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4107576c74842e7a92d18ec13934dc7',uuid=e3abd70e-baf7-4f13-832c-43696a5ea80c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "address": "fa:16:3e:0f:01:77", "network": {"id": "e5c35126-c724-438d-ac83-88c7304a8c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-84841748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beb79fc8bbc746178042b24a9019665c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd50d84f-cf", "ovs_interfaceid": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Converting VIF {"id": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "address": "fa:16:3e:0f:01:77", "network": {"id": "e5c35126-c724-438d-ac83-88c7304a8c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-84841748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beb79fc8bbc746178042b24a9019665c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd50d84f-cf", "ovs_interfaceid": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:01:77,bridge_name='br-int',has_traffic_filtering=True,id=cd50d84f-cf19-4b67-a73a-12005d5f5078,network=Network(e5c35126-c724-438d-ac83-88c7304a8c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd50d84f-cf') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG os_vif [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:01:77,bridge_name='br-int',has_traffic_filtering=True,id=cd50d84f-cf19-4b67-a73a-12005d5f5078,network=Network(e5c35126-c724-438d-ac83-88c7304a8c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd50d84f-cf') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56b1c5de-0e0c-5e74-b9b5-4f327e337958', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd50d84f-cf, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd50d84f-cf, col_values=(('qos', UUID('51b3e155-f3e5-4262-9ec9-303a56a0f2cb')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd50d84f-cf, col_values=(('external_ids', {'iface-id': 'cd50d84f-cf19-4b67-a73a-12005d5f5078', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:01:77', 'vm-uuid': 'e3abd70e-baf7-4f13-832c-43696a5ea80c'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:07 user nova-compute[75018]: INFO os_vif [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:01:77,bridge_name='br-int',has_traffic_filtering=True,id=cd50d84f-cf19-4b67-a73a-12005d5f5078,network=Network(e5c35126-c724-438d-ac83-88c7304a8c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd50d84f-cf')
Nov 07 15:21:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] No VIF found with MAC fa:16:3e:0f:01:77, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG nova.network.neutron [req-9376b7a4-3676-4e71-9240-329fd5196ce1 req-f9f3c497-4447-4782-9ff0-e14d9f41858f service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Updated VIF entry in instance network info cache for port cd50d84f-cf19-4b67-a73a-12005d5f5078. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG nova.network.neutron [req-9376b7a4-3676-4e71-9240-329fd5196ce1 req-f9f3c497-4447-4782-9ff0-e14d9f41858f service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Updating instance_info_cache with network_info: [{"id": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "address": "fa:16:3e:0f:01:77", "network": {"id": "e5c35126-c724-438d-ac83-88c7304a8c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-84841748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beb79fc8bbc746178042b24a9019665c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd50d84f-cf", "ovs_interfaceid": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9376b7a4-3676-4e71-9240-329fd5196ce1 req-f9f3c497-4447-4782-9ff0-e14d9f41858f service nova] Releasing lock "refresh_cache-e3abd70e-baf7-4f13-832c-43696a5ea80c" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG nova.compute.manager [req-2e73d9b3-9af8-4121-9eb2-ad0189eaf319 req-c8d65748-e6b7-4cc5-b110-06ca3634f1bb service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Received event network-vif-plugged-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2e73d9b3-9af8-4121-9eb2-ad0189eaf319 req-c8d65748-e6b7-4cc5-b110-06ca3634f1bb service nova] Acquiring lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2e73d9b3-9af8-4121-9eb2-ad0189eaf319 req-c8d65748-e6b7-4cc5-b110-06ca3634f1bb service nova] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2e73d9b3-9af8-4121-9eb2-ad0189eaf319 req-c8d65748-e6b7-4cc5-b110-06ca3634f1bb service nova] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:07 user nova-compute[75018]: DEBUG nova.compute.manager [req-2e73d9b3-9af8-4121-9eb2-ad0189eaf319 req-c8d65748-e6b7-4cc5-b110-06ca3634f1bb service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] No waiting events found dispatching network-vif-plugged-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:07 user nova-compute[75018]: WARNING nova.compute.manager [req-2e73d9b3-9af8-4121-9eb2-ad0189eaf319 req-c8d65748-e6b7-4cc5-b110-06ca3634f1bb service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Received unexpected event network-vif-plugged-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 for instance with vm_state active and task_state None.
Nov 07 15:21:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:08 user nova-compute[75018]: DEBUG nova.compute.manager [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:21:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:21:08 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Instance spawned successfully.
Nov 07 15:21:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:21:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:08 user nova-compute[75018]: INFO nova.compute.manager [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Took 9.64 seconds to spawn the instance on the hypervisor.
Nov 07 15:21:08 user nova-compute[75018]: DEBUG nova.compute.manager [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:21:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:08 user nova-compute[75018]: INFO nova.compute.manager [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Took 11.03 seconds to build instance.
Nov 07 15:21:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-18e651ef-e38b-4166-aa46-000c995e9dd0 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.156s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-002cabb3-1028-4c66-b90b-77d75c4398e0 req-7fe8d450-07c4-4c53-aef4-56a49d4984cf service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Received event network-vif-plugged-76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-002cabb3-1028-4c66-b90b-77d75c4398e0 req-7fe8d450-07c4-4c53-aef4-56a49d4984cf service nova] Acquiring lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-002cabb3-1028-4c66-b90b-77d75c4398e0 req-7fe8d450-07c4-4c53-aef4-56a49d4984cf service nova] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-002cabb3-1028-4c66-b90b-77d75c4398e0 req-7fe8d450-07c4-4c53-aef4-56a49d4984cf service nova] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-002cabb3-1028-4c66-b90b-77d75c4398e0 req-7fe8d450-07c4-4c53-aef4-56a49d4984cf service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] No waiting events found dispatching network-vif-plugged-76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:09 user nova-compute[75018]: WARNING nova.compute.manager [req-002cabb3-1028-4c66-b90b-77d75c4398e0 req-7fe8d450-07c4-4c53-aef4-56a49d4984cf service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Received unexpected event network-vif-plugged-76649643-812d-4246-873b-3209e1d13b85 for instance with vm_state active and task_state None.
Nov 07 15:21:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-a93adde2-218a-4874-82ce-9cf0a2f2eaba req-e613d984-e900-4e7b-8dd9-e6dc5ec21553 service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Received event network-vif-plugged-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a93adde2-218a-4874-82ce-9cf0a2f2eaba req-e613d984-e900-4e7b-8dd9-e6dc5ec21553 service nova] Acquiring lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a93adde2-218a-4874-82ce-9cf0a2f2eaba req-e613d984-e900-4e7b-8dd9-e6dc5ec21553 service nova] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a93adde2-218a-4874-82ce-9cf0a2f2eaba req-e613d984-e900-4e7b-8dd9-e6dc5ec21553 service nova] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-a93adde2-218a-4874-82ce-9cf0a2f2eaba req-e613d984-e900-4e7b-8dd9-e6dc5ec21553 service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] No waiting events found dispatching network-vif-plugged-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:09 user nova-compute[75018]: WARNING nova.compute.manager [req-a93adde2-218a-4874-82ce-9cf0a2f2eaba req-e613d984-e900-4e7b-8dd9-e6dc5ec21553 service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Received unexpected event network-vif-plugged-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 for instance with vm_state active and task_state None.
Nov 07 15:21:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Received event network-vif-plugged-76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] Acquiring lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] No waiting events found dispatching network-vif-plugged-76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:11 user nova-compute[75018]: WARNING nova.compute.manager [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Received unexpected event network-vif-plugged-76649643-812d-4246-873b-3209e1d13b85 for instance with vm_state active and task_state None.
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received event network-vif-plugged-5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] Acquiring lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] No waiting events found dispatching network-vif-plugged-5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:11 user nova-compute[75018]: WARNING nova.compute.manager [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received unexpected event network-vif-plugged-5b3da5d6-6cee-4668-b7cd-5d328309eca6 for instance with vm_state active and task_state None.
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received event network-vif-plugged-5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] Acquiring lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] No waiting events found dispatching network-vif-plugged-5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:11 user nova-compute[75018]: WARNING nova.compute.manager [req-1adf7ed7-938e-405e-8391-b474aee42d85 req-29c303b4-759a-4e43-a842-00da9864eb68 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received unexpected event network-vif-plugged-5b3da5d6-6cee-4668-b7cd-5d328309eca6 for instance with vm_state active and task_state None.
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:21:11 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Instance spawned successfully.
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:11 user nova-compute[75018]: INFO nova.compute.manager [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Took 6.73 seconds to spawn the instance on the hypervisor.
Nov 07 15:21:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:21:11 user nova-compute[75018]: INFO nova.compute.manager [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Took 7.80 seconds to build instance.
Nov 07 15:21:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9b02feb9-9452-40d8-a078-736cc65ad6a7 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.936s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Acquiring lock "22422ecc-1027-41c5-9bea-066fdc8ca995" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "22422ecc-1027-41c5-9bea-066fdc8ca995" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:12 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:21:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:12 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:21:12 user nova-compute[75018]: INFO nova.compute.claims [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Claim successful on node user
Nov 07 15:21:13 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:21:13 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:21:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG nova.policy [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '281366ac5ac043f3957d5e1631da55fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea5237b6bae4a6bb2f99aaa97f0a7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] There are 0 instances to clean {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75018) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:21:13 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Creating image(s)
Nov 07 15:21:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Acquiring lock "/opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "/opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "/opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.201s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.195s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk 1073741824" returned: 0 in 0.060s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG nova.compute.manager [req-95d5da20-11d7-47bc-abf7-80cbc9e05be3 req-f11d8109-514d-4ee5-a7fc-d1dbb99e072f service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Received event network-vif-plugged-cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-95d5da20-11d7-47bc-abf7-80cbc9e05be3 req-f11d8109-514d-4ee5-a7fc-d1dbb99e072f service nova] Acquiring lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-95d5da20-11d7-47bc-abf7-80cbc9e05be3 req-f11d8109-514d-4ee5-a7fc-d1dbb99e072f service nova] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-95d5da20-11d7-47bc-abf7-80cbc9e05be3 req-f11d8109-514d-4ee5-a7fc-d1dbb99e072f service nova] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG nova.compute.manager [req-95d5da20-11d7-47bc-abf7-80cbc9e05be3 req-f11d8109-514d-4ee5-a7fc-d1dbb99e072f service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] No waiting events found dispatching network-vif-plugged-cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:14 user nova-compute[75018]: WARNING nova.compute.manager [req-95d5da20-11d7-47bc-abf7-80cbc9e05be3 req-f11d8109-514d-4ee5-a7fc-d1dbb99e072f service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Received unexpected event network-vif-plugged-cd50d84f-cf19-4b67-a73a-12005d5f5078 for instance with vm_state active and task_state None.
Nov 07 15:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.262s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Successfully created port: 798cf71a-7966-4f68-b9ee-18e46b62c089 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Cannot resize image /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Ensure instance console log exists: /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Successfully updated port: 798cf71a-7966-4f68-b9ee-18e46b62c089 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Acquiring lock "refresh_cache-22422ecc-1027-41c5-9bea-066fdc8ca995" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Acquired lock "refresh_cache-22422ecc-1027-41c5-9bea-066fdc8ca995" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Updating instance_info_cache with network_info: [{"id": "798cf71a-7966-4f68-b9ee-18e46b62c089", "address": "fa:16:3e:3a:85:3c", "network": {"id": "57e31aa5-49e6-4f0f-b380-474450060dbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-194571543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea5237b6bae4a6bb2f99aaa97f0a7a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf71a-79", "ovs_interfaceid": "798cf71a-7966-4f68-b9ee-18e46b62c089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Releasing lock "refresh_cache-22422ecc-1027-41c5-9bea-066fdc8ca995" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Instance network_info: |[{"id": "798cf71a-7966-4f68-b9ee-18e46b62c089", "address": "fa:16:3e:3a:85:3c", "network": {"id": "57e31aa5-49e6-4f0f-b380-474450060dbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-194571543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea5237b6bae4a6bb2f99aaa97f0a7a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf71a-79", "ovs_interfaceid": "798cf71a-7966-4f68-b9ee-18e46b62c089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Start _get_guest_xml network_info=[{"id": "798cf71a-7966-4f68-b9ee-18e46b62c089", "address": "fa:16:3e:3a:85:3c", "network": {"id": "57e31aa5-49e6-4f0f-b380-474450060dbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-194571543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea5237b6bae4a6bb2f99aaa97f0a7a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf71a-79", "ovs_interfaceid": "798cf71a-7966-4f68-b9ee-18e46b62c089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:21:15 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:21:15 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1387159450',display_name='tempest-VolumesActionsTest-instance-1387159450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1387159450',id=8,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea5237b6bae4a6bb2f99aaa97f0a7a4',ramdisk_id='',reservation_id='r-c8v3pkrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1778955523',owner_user_name='tempest-VolumesActionsTest-1778955523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:21:14Z,user_data=None,user_id='281366ac5ac043f3957d5e1631da55fc',uuid=22422ecc-1027-41c5-9bea-066fdc8ca995,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "798cf71a-7966-4f68-b9ee-18e46b62c089", "address": "fa:16:3e:3a:85:3c", "network": {"id": "57e31aa5-49e6-4f0f-b380-474450060dbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-194571543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea5237b6bae4a6bb2f99aaa97f0a7a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf71a-79", "ovs_interfaceid": "798cf71a-7966-4f68-b9ee-18e46b62c089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Converting VIF {"id": "798cf71a-7966-4f68-b9ee-18e46b62c089", "address": "fa:16:3e:3a:85:3c", "network": {"id": "57e31aa5-49e6-4f0f-b380-474450060dbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-194571543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea5237b6bae4a6bb2f99aaa97f0a7a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf71a-79", "ovs_interfaceid": "798cf71a-7966-4f68-b9ee-18e46b62c089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:85:3c,bridge_name='br-int',has_traffic_filtering=True,id=798cf71a-7966-4f68-b9ee-18e46b62c089,network=Network(57e31aa5-49e6-4f0f-b380-474450060dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798cf71a-79') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lazy-loading 'pci_devices' on Instance uuid 22422ecc-1027-41c5-9bea-066fdc8ca995 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.compute.manager [req-4ef478b6-bfac-45d9-a97e-a7371ff86582 req-374e5493-e59f-42ee-99e4-8b617fa96052 service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Received event network-changed-798cf71a-7966-4f68-b9ee-18e46b62c089 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.compute.manager [req-4ef478b6-bfac-45d9-a97e-a7371ff86582 req-374e5493-e59f-42ee-99e4-8b617fa96052 service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Refreshing instance network info cache due to event network-changed-798cf71a-7966-4f68-b9ee-18e46b62c089. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4ef478b6-bfac-45d9-a97e-a7371ff86582 req-374e5493-e59f-42ee-99e4-8b617fa96052 service nova] Acquiring lock "refresh_cache-22422ecc-1027-41c5-9bea-066fdc8ca995" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4ef478b6-bfac-45d9-a97e-a7371ff86582 req-374e5493-e59f-42ee-99e4-8b617fa96052 service nova] Acquired lock "refresh_cache-22422ecc-1027-41c5-9bea-066fdc8ca995" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.network.neutron [req-4ef478b6-bfac-45d9-a97e-a7371ff86582 req-374e5493-e59f-42ee-99e4-8b617fa96052 service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Refreshing network info cache for port 798cf71a-7966-4f68-b9ee-18e46b62c089 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:21:15 user nova-compute[75018]:   <uuid>22422ecc-1027-41c5-9bea-066fdc8ca995</uuid>
Nov 07 15:21:15 user nova-compute[75018]:   <name>instance-00000008</name>
Nov 07 15:21:15 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:21:15 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:21:15 user nova-compute[75018]:   <metadata>
Nov 07 15:21:15 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:21:15 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:21:15 user nova-compute[75018]:       <nova:name>tempest-VolumesActionsTest-instance-1387159450</nova:name>
Nov 07 15:21:15 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:21:15</nova:creationTime>
Nov 07 15:21:15 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:21:15 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:21:15 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:21:15 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:21:15 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:21:15 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:21:15 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:21:15 user nova-compute[75018]:       <nova:owner>
Nov 07 15:21:15 user nova-compute[75018]:         <nova:user uuid="281366ac5ac043f3957d5e1631da55fc">tempest-VolumesActionsTest-1778955523-project-member</nova:user>
Nov 07 15:21:15 user nova-compute[75018]:         <nova:project uuid="3ea5237b6bae4a6bb2f99aaa97f0a7a4">tempest-VolumesActionsTest-1778955523</nova:project>
Nov 07 15:21:15 user nova-compute[75018]:       </nova:owner>
Nov 07 15:21:15 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:21:15 user nova-compute[75018]:       <nova:ports>
Nov 07 15:21:15 user nova-compute[75018]:         <nova:port uuid="798cf71a-7966-4f68-b9ee-18e46b62c089">
Nov 07 15:21:15 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 15:21:15 user nova-compute[75018]:         </nova:port>
Nov 07 15:21:15 user nova-compute[75018]:       </nova:ports>
Nov 07 15:21:15 user nova-compute[75018]:     </nova:instance>
Nov 07 15:21:15 user nova-compute[75018]:   </metadata>
Nov 07 15:21:15 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:21:15 user nova-compute[75018]:     <system>
Nov 07 15:21:15 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:21:15 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:21:15 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:21:15 user nova-compute[75018]:       <entry name="serial">22422ecc-1027-41c5-9bea-066fdc8ca995</entry>
Nov 07 15:21:15 user nova-compute[75018]:       <entry name="uuid">22422ecc-1027-41c5-9bea-066fdc8ca995</entry>
Nov 07 15:21:15 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:21:15 user nova-compute[75018]:     </system>
Nov 07 15:21:15 user nova-compute[75018]:   </sysinfo>
Nov 07 15:21:15 user nova-compute[75018]:   <os>
Nov 07 15:21:15 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:21:15 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:21:15 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:21:15 user nova-compute[75018]:   </os>
Nov 07 15:21:15 user nova-compute[75018]:   <features>
Nov 07 15:21:15 user nova-compute[75018]:     <acpi/>
Nov 07 15:21:15 user nova-compute[75018]:     <apic/>
Nov 07 15:21:15 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:21:15 user nova-compute[75018]:   </features>
Nov 07 15:21:15 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:21:15 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:21:15 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:21:15 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:21:15 user nova-compute[75018]:   </clock>
Nov 07 15:21:15 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:21:15 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:21:15 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:21:15 user nova-compute[75018]:   </cpu>
Nov 07 15:21:15 user nova-compute[75018]:   <devices>
Nov 07 15:21:15 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:21:15 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:21:15 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk"/>
Nov 07 15:21:15 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:21:15 user nova-compute[75018]:     </disk>
Nov 07 15:21:15 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:21:15 user nova-compute[75018]:       <mac address="fa:16:3e:3a:85:3c"/>
Nov 07 15:21:15 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:21:15 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:21:15 user nova-compute[75018]:       <target dev="tap798cf71a-79"/>
Nov 07 15:21:15 user nova-compute[75018]:     </interface>
Nov 07 15:21:15 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:21:15 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/console.log" append="off"/>
Nov 07 15:21:15 user nova-compute[75018]:     </serial>
Nov 07 15:21:15 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:21:15 user nova-compute[75018]:     <video>
Nov 07 15:21:15 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:21:15 user nova-compute[75018]:     </video>
Nov 07 15:21:15 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:21:15 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:21:15 user nova-compute[75018]:     </rng>
Nov 07 15:21:15 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:21:15 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:21:15 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:21:15 user nova-compute[75018]:     </memballoon>
Nov 07 15:21:15 user nova-compute[75018]:   </devices>
Nov 07 15:21:15 user nova-compute[75018]: </domain>
Nov 07 15:21:15 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1387159450',display_name='tempest-VolumesActionsTest-instance-1387159450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1387159450',id=8,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea5237b6bae4a6bb2f99aaa97f0a7a4',ramdisk_id='',reservation_id='r-c8v3pkrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1778955523',owner_user_name='tempest-VolumesActionsTest-1778955523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:21:14Z,user_data=None,user_id='281366ac5ac043f3957d5e1631da55fc',uuid=22422ecc-1027-41c5-9bea-066fdc8ca995,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "798cf71a-7966-4f68-b9ee-18e46b62c089", "address": "fa:16:3e:3a:85:3c", "network": {"id": "57e31aa5-49e6-4f0f-b380-474450060dbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-194571543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea5237b6bae4a6bb2f99aaa97f0a7a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf71a-79", "ovs_interfaceid": "798cf71a-7966-4f68-b9ee-18e46b62c089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Converting VIF {"id": "798cf71a-7966-4f68-b9ee-18e46b62c089", "address": "fa:16:3e:3a:85:3c", "network": {"id": "57e31aa5-49e6-4f0f-b380-474450060dbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-194571543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea5237b6bae4a6bb2f99aaa97f0a7a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf71a-79", "ovs_interfaceid": "798cf71a-7966-4f68-b9ee-18e46b62c089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:85:3c,bridge_name='br-int',has_traffic_filtering=True,id=798cf71a-7966-4f68-b9ee-18e46b62c089,network=Network(57e31aa5-49e6-4f0f-b380-474450060dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798cf71a-79') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG os_vif [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:85:3c,bridge_name='br-int',has_traffic_filtering=True,id=798cf71a-7966-4f68-b9ee-18e46b62c089,network=Network(57e31aa5-49e6-4f0f-b380-474450060dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798cf71a-79') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b116b1d-0e99-57da-b942-64f5c26268e6', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap798cf71a-79, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap798cf71a-79, col_values=(('qos', UUID('407bfc21-9ffb-47d2-a901-498c03db47b5')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap798cf71a-79, col_values=(('external_ids', {'iface-id': '798cf71a-7966-4f68-b9ee-18e46b62c089', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:85:3c', 'vm-uuid': '22422ecc-1027-41c5-9bea-066fdc8ca995'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:21:15 user nova-compute[75018]: INFO os_vif [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:85:3c,bridge_name='br-int',has_traffic_filtering=True,id=798cf71a-7966-4f68-b9ee-18e46b62c089,network=Network(57e31aa5-49e6-4f0f-b380-474450060dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798cf71a-79')
Nov 07 15:21:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:21:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] No VIF found with MAC fa:16:3e:3a:85:3c, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG nova.network.neutron [req-4ef478b6-bfac-45d9-a97e-a7371ff86582 req-374e5493-e59f-42ee-99e4-8b617fa96052 service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Updated VIF entry in instance network info cache for port 798cf71a-7966-4f68-b9ee-18e46b62c089. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG nova.network.neutron [req-4ef478b6-bfac-45d9-a97e-a7371ff86582 req-374e5493-e59f-42ee-99e4-8b617fa96052 service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Updating instance_info_cache with network_info: [{"id": "798cf71a-7966-4f68-b9ee-18e46b62c089", "address": "fa:16:3e:3a:85:3c", "network": {"id": "57e31aa5-49e6-4f0f-b380-474450060dbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-194571543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea5237b6bae4a6bb2f99aaa97f0a7a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf71a-79", "ovs_interfaceid": "798cf71a-7966-4f68-b9ee-18e46b62c089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4ef478b6-bfac-45d9-a97e-a7371ff86582 req-374e5493-e59f-42ee-99e4-8b617fa96052 service nova] Releasing lock "refresh_cache-22422ecc-1027-41c5-9bea-066fdc8ca995" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-380e1e2a-ba31-44c4-a07a-31cdba22cde3 req-3a3efcf5-aab6-4b7b-b9d1-7c6196b16c9a service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Received event network-vif-plugged-cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-380e1e2a-ba31-44c4-a07a-31cdba22cde3 req-3a3efcf5-aab6-4b7b-b9d1-7c6196b16c9a service nova] Acquiring lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-380e1e2a-ba31-44c4-a07a-31cdba22cde3 req-3a3efcf5-aab6-4b7b-b9d1-7c6196b16c9a service nova] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-380e1e2a-ba31-44c4-a07a-31cdba22cde3 req-3a3efcf5-aab6-4b7b-b9d1-7c6196b16c9a service nova] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-380e1e2a-ba31-44c4-a07a-31cdba22cde3 req-3a3efcf5-aab6-4b7b-b9d1-7c6196b16c9a service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] No waiting events found dispatching network-vif-plugged-cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:16 user nova-compute[75018]: WARNING nova.compute.manager [req-380e1e2a-ba31-44c4-a07a-31cdba22cde3 req-3a3efcf5-aab6-4b7b-b9d1-7c6196b16c9a service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Received unexpected event network-vif-plugged-cd50d84f-cf19-4b67-a73a-12005d5f5078 for instance with vm_state active and task_state None.
Nov 07 15:21:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Skipping network cache update for instance because it is Building. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:21:16 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid 8257c590-204a-4fde-8487-79b8c0c87ea7 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating instance_info_cache with network_info: [{"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG nova.compute.manager [req-64304bc8-fbd2-4279-a3bc-af9fdb022598 req-2a76faba-abbe-41c7-96e6-d78bd622ebdc service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Received event network-vif-plugged-798cf71a-7966-4f68-b9ee-18e46b62c089 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-64304bc8-fbd2-4279-a3bc-af9fdb022598 req-2a76faba-abbe-41c7-96e6-d78bd622ebdc service nova] Acquiring lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-64304bc8-fbd2-4279-a3bc-af9fdb022598 req-2a76faba-abbe-41c7-96e6-d78bd622ebdc service nova] Lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-64304bc8-fbd2-4279-a3bc-af9fdb022598 req-2a76faba-abbe-41c7-96e6-d78bd622ebdc service nova] Lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG nova.compute.manager [req-64304bc8-fbd2-4279-a3bc-af9fdb022598 req-2a76faba-abbe-41c7-96e6-d78bd622ebdc service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] No waiting events found dispatching network-vif-plugged-798cf71a-7966-4f68-b9ee-18e46b62c089 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:17 user nova-compute[75018]: WARNING nova.compute.manager [req-64304bc8-fbd2-4279-a3bc-af9fdb022598 req-2a76faba-abbe-41c7-96e6-d78bd622ebdc service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Received unexpected event network-vif-plugged-798cf71a-7966-4f68-b9ee-18e46b62c089 for instance with vm_state building and task_state spawning.
Nov 07 15:21:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:21:19 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Instance spawned successfully.
Nov 07 15:21:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG nova.compute.manager [req-7046f373-1ac7-41db-82eb-2b9671afcfbc req-751687a4-61fa-4aec-8174-623f47e5d5f5 service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Received event network-vif-plugged-798cf71a-7966-4f68-b9ee-18e46b62c089 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7046f373-1ac7-41db-82eb-2b9671afcfbc req-751687a4-61fa-4aec-8174-623f47e5d5f5 service nova] Acquiring lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7046f373-1ac7-41db-82eb-2b9671afcfbc req-751687a4-61fa-4aec-8174-623f47e5d5f5 service nova] Lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7046f373-1ac7-41db-82eb-2b9671afcfbc req-751687a4-61fa-4aec-8174-623f47e5d5f5 service nova] Lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG nova.compute.manager [req-7046f373-1ac7-41db-82eb-2b9671afcfbc req-751687a4-61fa-4aec-8174-623f47e5d5f5 service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] No waiting events found dispatching network-vif-plugged-798cf71a-7966-4f68-b9ee-18e46b62c089 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:19 user nova-compute[75018]: WARNING nova.compute.manager [req-7046f373-1ac7-41db-82eb-2b9671afcfbc req-751687a4-61fa-4aec-8174-623f47e5d5f5 service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Received unexpected event network-vif-plugged-798cf71a-7966-4f68-b9ee-18e46b62c089 for instance with vm_state building and task_state spawning.
Nov 07 15:21:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:20 user nova-compute[75018]: INFO nova.compute.manager [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 07 15:21:20 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:21:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:20 user nova-compute[75018]: INFO nova.compute.manager [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Took 7.46 seconds to build instance.
Nov 07 15:21:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c813f9e3-b56b-46b9-bdb3-9ecf5deaf888 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "22422ecc-1027-41c5-9bea-066fdc8ca995" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.632s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:21 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:21:21 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:21:21 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7774MB free_disk=25.49797821044922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:21:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8257c590-204a-4fde-8487-79b8c0c87ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance eb712362-b6b8-4a19-8f5b-8c374d6c4d87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance b8d3da3e-3927-4f4e-b9a3-994d45d5a408 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 569b9815-efc4-46d0-832e-9931fdd7d6ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e3abd70e-baf7-4f13-832c-43696a5ea80c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 22422ecc-1027-41c5-9bea-066fdc8ca995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Acquiring lock "d5341681-9ba6-4f21-a67c-00d50aea8762" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:21:22 user nova-compute[75018]: INFO nova.compute.claims [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Claim successful on node user
Nov 07 15:21:22 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Refreshing inventories for resource provider 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Updating ProviderTree inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Refreshing aggregate associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, aggregates: None {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Refreshing trait associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:21:23 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:21:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG nova.policy [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fedf60e31c148598e805335cc3f7e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9378a0a596064f23a0e85400f26a7710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:21:23 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Creating image(s)
Nov 07 15:21:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "/opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "/opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.198s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.238s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk 1073741824" returned: 0 in 0.075s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Successfully created port: 9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.218s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Cannot resize image /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Ensure instance console log exists: /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Successfully updated port: 9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Acquiring lock "refresh_cache-d5341681-9ba6-4f21-a67c-00d50aea8762" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Acquired lock "refresh_cache-d5341681-9ba6-4f21-a67c-00d50aea8762" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-90331bdd-c3e1-477d-bb5d-d3a802cfed5b req-11ab6091-0049-4c4b-9c0d-4b9df600c12b service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Received event network-changed-9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-90331bdd-c3e1-477d-bb5d-d3a802cfed5b req-11ab6091-0049-4c4b-9c0d-4b9df600c12b service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Refreshing instance network info cache due to event network-changed-9fcc5742-dd8b-4205-be25-c16830b915a4. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-90331bdd-c3e1-477d-bb5d-d3a802cfed5b req-11ab6091-0049-4c4b-9c0d-4b9df600c12b service nova] Acquiring lock "refresh_cache-d5341681-9ba6-4f21-a67c-00d50aea8762" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Updating instance_info_cache with network_info: [{"id": "9fcc5742-dd8b-4205-be25-c16830b915a4", "address": "fa:16:3e:5c:7f:f5", "network": {"id": "05954183-75be-4860-8cc3-fcb57270fc76", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1012347870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9378a0a596064f23a0e85400f26a7710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fcc5742-dd", "ovs_interfaceid": "9fcc5742-dd8b-4205-be25-c16830b915a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Releasing lock "refresh_cache-d5341681-9ba6-4f21-a67c-00d50aea8762" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Instance network_info: |[{"id": "9fcc5742-dd8b-4205-be25-c16830b915a4", "address": "fa:16:3e:5c:7f:f5", "network": {"id": "05954183-75be-4860-8cc3-fcb57270fc76", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1012347870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9378a0a596064f23a0e85400f26a7710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fcc5742-dd", "ovs_interfaceid": "9fcc5742-dd8b-4205-be25-c16830b915a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-90331bdd-c3e1-477d-bb5d-d3a802cfed5b req-11ab6091-0049-4c4b-9c0d-4b9df600c12b service nova] Acquired lock "refresh_cache-d5341681-9ba6-4f21-a67c-00d50aea8762" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.network.neutron [req-90331bdd-c3e1-477d-bb5d-d3a802cfed5b req-11ab6091-0049-4c4b-9c0d-4b9df600c12b service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Refreshing network info cache for port 9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Start _get_guest_xml network_info=[{"id": "9fcc5742-dd8b-4205-be25-c16830b915a4", "address": "fa:16:3e:5c:7f:f5", "network": {"id": "05954183-75be-4860-8cc3-fcb57270fc76", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1012347870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9378a0a596064f23a0e85400f26a7710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fcc5742-dd", "ovs_interfaceid": "9fcc5742-dd8b-4205-be25-c16830b915a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:25 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:21:25 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-810810545',display_name='tempest-VolumesAssistedSnapshotsTest-server-810810545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-810810545',id=9,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAPyX9V89fczum9xkG1E1E0AS3SWjaJT5WmQNz2abfZ6UHlZjJrbgR8qM4dLn+3JJcC6AjXNHJzJSwHdd4vrdllS+3FzP/01filvLmE/LWIvp1Vy+JfKOoKO/R0m5fZDw==',key_name='tempest-keypair-719431615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378a0a596064f23a0e85400f26a7710',ramdisk_id='',reservation_id='r-zjbzabde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-326356531',owner_user_name='tempest-VolumesAssistedSnapshotsTest-326356531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:21:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fedf60e31c148598e805335cc3f7e50',uuid=d5341681-9ba6-4f21-a67c-00d50aea8762,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fcc5742-dd8b-4205-be25-c16830b915a4", "address": "fa:16:3e:5c:7f:f5", "network": {"id": "05954183-75be-4860-8cc3-fcb57270fc76", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1012347870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9378a0a596064f23a0e85400f26a7710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fcc5742-dd", "ovs_interfaceid": "9fcc5742-dd8b-4205-be25-c16830b915a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Converting VIF {"id": "9fcc5742-dd8b-4205-be25-c16830b915a4", "address": "fa:16:3e:5c:7f:f5", "network": {"id": "05954183-75be-4860-8cc3-fcb57270fc76", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1012347870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9378a0a596064f23a0e85400f26a7710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fcc5742-dd", "ovs_interfaceid": "9fcc5742-dd8b-4205-be25-c16830b915a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:7f:f5,bridge_name='br-int',has_traffic_filtering=True,id=9fcc5742-dd8b-4205-be25-c16830b915a4,network=Network(05954183-75be-4860-8cc3-fcb57270fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fcc5742-dd') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lazy-loading 'pci_devices' on Instance uuid d5341681-9ba6-4f21-a67c-00d50aea8762 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:21:25 user nova-compute[75018]:   <uuid>d5341681-9ba6-4f21-a67c-00d50aea8762</uuid>
Nov 07 15:21:25 user nova-compute[75018]:   <name>instance-00000009</name>
Nov 07 15:21:25 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:21:25 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:21:25 user nova-compute[75018]:   <metadata>
Nov 07 15:21:25 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:21:25 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:21:25 user nova-compute[75018]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-810810545</nova:name>
Nov 07 15:21:25 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:21:25</nova:creationTime>
Nov 07 15:21:25 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:21:25 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:21:25 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:21:25 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:21:25 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:21:25 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:21:25 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:21:25 user nova-compute[75018]:       <nova:owner>
Nov 07 15:21:25 user nova-compute[75018]:         <nova:user uuid="7fedf60e31c148598e805335cc3f7e50">tempest-VolumesAssistedSnapshotsTest-326356531-project-member</nova:user>
Nov 07 15:21:25 user nova-compute[75018]:         <nova:project uuid="9378a0a596064f23a0e85400f26a7710">tempest-VolumesAssistedSnapshotsTest-326356531</nova:project>
Nov 07 15:21:25 user nova-compute[75018]:       </nova:owner>
Nov 07 15:21:25 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:21:25 user nova-compute[75018]:       <nova:ports>
Nov 07 15:21:25 user nova-compute[75018]:         <nova:port uuid="9fcc5742-dd8b-4205-be25-c16830b915a4">
Nov 07 15:21:25 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 07 15:21:25 user nova-compute[75018]:         </nova:port>
Nov 07 15:21:25 user nova-compute[75018]:       </nova:ports>
Nov 07 15:21:25 user nova-compute[75018]:     </nova:instance>
Nov 07 15:21:25 user nova-compute[75018]:   </metadata>
Nov 07 15:21:25 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:21:25 user nova-compute[75018]:     <system>
Nov 07 15:21:25 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:21:25 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:21:25 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:21:25 user nova-compute[75018]:       <entry name="serial">d5341681-9ba6-4f21-a67c-00d50aea8762</entry>
Nov 07 15:21:25 user nova-compute[75018]:       <entry name="uuid">d5341681-9ba6-4f21-a67c-00d50aea8762</entry>
Nov 07 15:21:25 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:21:25 user nova-compute[75018]:     </system>
Nov 07 15:21:25 user nova-compute[75018]:   </sysinfo>
Nov 07 15:21:25 user nova-compute[75018]:   <os>
Nov 07 15:21:25 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:21:25 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:21:25 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:21:25 user nova-compute[75018]:   </os>
Nov 07 15:21:25 user nova-compute[75018]:   <features>
Nov 07 15:21:25 user nova-compute[75018]:     <acpi/>
Nov 07 15:21:25 user nova-compute[75018]:     <apic/>
Nov 07 15:21:25 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:21:25 user nova-compute[75018]:   </features>
Nov 07 15:21:25 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:21:25 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:21:25 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:21:25 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:21:25 user nova-compute[75018]:   </clock>
Nov 07 15:21:25 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:21:25 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:21:25 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:21:25 user nova-compute[75018]:   </cpu>
Nov 07 15:21:25 user nova-compute[75018]:   <devices>
Nov 07 15:21:25 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:21:25 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:21:25 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk"/>
Nov 07 15:21:25 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:21:25 user nova-compute[75018]:     </disk>
Nov 07 15:21:25 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:21:25 user nova-compute[75018]:       <mac address="fa:16:3e:5c:7f:f5"/>
Nov 07 15:21:25 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:21:25 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:21:25 user nova-compute[75018]:       <target dev="tap9fcc5742-dd"/>
Nov 07 15:21:25 user nova-compute[75018]:     </interface>
Nov 07 15:21:25 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:21:25 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/console.log" append="off"/>
Nov 07 15:21:25 user nova-compute[75018]:     </serial>
Nov 07 15:21:25 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:21:25 user nova-compute[75018]:     <video>
Nov 07 15:21:25 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:21:25 user nova-compute[75018]:     </video>
Nov 07 15:21:25 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:21:25 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:21:25 user nova-compute[75018]:     </rng>
Nov 07 15:21:25 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:21:25 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:21:25 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:21:25 user nova-compute[75018]:     </memballoon>
Nov 07 15:21:25 user nova-compute[75018]:   </devices>
Nov 07 15:21:25 user nova-compute[75018]: </domain>
Nov 07 15:21:25 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-810810545',display_name='tempest-VolumesAssistedSnapshotsTest-server-810810545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-810810545',id=9,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAPyX9V89fczum9xkG1E1E0AS3SWjaJT5WmQNz2abfZ6UHlZjJrbgR8qM4dLn+3JJcC6AjXNHJzJSwHdd4vrdllS+3FzP/01filvLmE/LWIvp1Vy+JfKOoKO/R0m5fZDw==',key_name='tempest-keypair-719431615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9378a0a596064f23a0e85400f26a7710',ramdisk_id='',reservation_id='r-zjbzabde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-326356531',owner_user_name='tempest-VolumesAssistedSnapshotsTest-326356531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:21:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fedf60e31c148598e805335cc3f7e50',uuid=d5341681-9ba6-4f21-a67c-00d50aea8762,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fcc5742-dd8b-4205-be25-c16830b915a4", "address": "fa:16:3e:5c:7f:f5", "network": {"id": "05954183-75be-4860-8cc3-fcb57270fc76", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1012347870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9378a0a596064f23a0e85400f26a7710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fcc5742-dd", "ovs_interfaceid": "9fcc5742-dd8b-4205-be25-c16830b915a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Converting VIF {"id": "9fcc5742-dd8b-4205-be25-c16830b915a4", "address": "fa:16:3e:5c:7f:f5", "network": {"id": "05954183-75be-4860-8cc3-fcb57270fc76", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1012347870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9378a0a596064f23a0e85400f26a7710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fcc5742-dd", "ovs_interfaceid": "9fcc5742-dd8b-4205-be25-c16830b915a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:7f:f5,bridge_name='br-int',has_traffic_filtering=True,id=9fcc5742-dd8b-4205-be25-c16830b915a4,network=Network(05954183-75be-4860-8cc3-fcb57270fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fcc5742-dd') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG os_vif [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:7f:f5,bridge_name='br-int',has_traffic_filtering=True,id=9fcc5742-dd8b-4205-be25-c16830b915a4,network=Network(05954183-75be-4860-8cc3-fcb57270fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fcc5742-dd') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96102c80-08eb-5383-98ea-622487b4634c', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fcc5742-dd, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9fcc5742-dd, col_values=(('qos', UUID('7685347d-1925-4c50-b66f-21ca76b326fc')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9fcc5742-dd, col_values=(('external_ids', {'iface-id': '9fcc5742-dd8b-4205-be25-c16830b915a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:7f:f5', 'vm-uuid': 'd5341681-9ba6-4f21-a67c-00d50aea8762'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:25 user nova-compute[75018]: INFO os_vif [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:7f:f5,bridge_name='br-int',has_traffic_filtering=True,id=9fcc5742-dd8b-4205-be25-c16830b915a4,network=Network(05954183-75be-4860-8cc3-fcb57270fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fcc5742-dd')
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:21:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] No VIF found with MAC fa:16:3e:5c:7f:f5, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:21:26 user nova-compute[75018]: DEBUG nova.network.neutron [req-90331bdd-c3e1-477d-bb5d-d3a802cfed5b req-11ab6091-0049-4c4b-9c0d-4b9df600c12b service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Updated VIF entry in instance network info cache for port 9fcc5742-dd8b-4205-be25-c16830b915a4. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:21:26 user nova-compute[75018]: DEBUG nova.network.neutron [req-90331bdd-c3e1-477d-bb5d-d3a802cfed5b req-11ab6091-0049-4c4b-9c0d-4b9df600c12b service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Updating instance_info_cache with network_info: [{"id": "9fcc5742-dd8b-4205-be25-c16830b915a4", "address": "fa:16:3e:5c:7f:f5", "network": {"id": "05954183-75be-4860-8cc3-fcb57270fc76", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1012347870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9378a0a596064f23a0e85400f26a7710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fcc5742-dd", "ovs_interfaceid": "9fcc5742-dd8b-4205-be25-c16830b915a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:21:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-90331bdd-c3e1-477d-bb5d-d3a802cfed5b req-11ab6091-0049-4c4b-9c0d-4b9df600c12b service nova] Releasing lock "refresh_cache-d5341681-9ba6-4f21-a67c-00d50aea8762" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:21:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:27 user nova-compute[75018]: DEBUG nova.compute.manager [req-6e3a1f9c-8a62-425f-b1a6-f94a9c10d5a9 req-0d149d14-9c8f-439e-8286-61ea8faf4468 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Received event network-vif-plugged-9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6e3a1f9c-8a62-425f-b1a6-f94a9c10d5a9 req-0d149d14-9c8f-439e-8286-61ea8faf4468 service nova] Acquiring lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6e3a1f9c-8a62-425f-b1a6-f94a9c10d5a9 req-0d149d14-9c8f-439e-8286-61ea8faf4468 service nova] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6e3a1f9c-8a62-425f-b1a6-f94a9c10d5a9 req-0d149d14-9c8f-439e-8286-61ea8faf4468 service nova] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:27 user nova-compute[75018]: DEBUG nova.compute.manager [req-6e3a1f9c-8a62-425f-b1a6-f94a9c10d5a9 req-0d149d14-9c8f-439e-8286-61ea8faf4468 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] No waiting events found dispatching network-vif-plugged-9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:27 user nova-compute[75018]: WARNING nova.compute.manager [req-6e3a1f9c-8a62-425f-b1a6-f94a9c10d5a9 req-0d149d14-9c8f-439e-8286-61ea8faf4468 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Received unexpected event network-vif-plugged-9fcc5742-dd8b-4205-be25-c16830b915a4 for instance with vm_state building and task_state spawning.
Nov 07 15:21:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:21:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:21:29 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Instance spawned successfully.
Nov 07 15:21:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:21:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:21:29 user nova-compute[75018]: INFO nova.compute.manager [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 07 15:21:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:21:29 user nova-compute[75018]: DEBUG nova.compute.manager [req-71918b67-8d5f-4f5e-b217-d53110764cb7 req-e160e533-efcc-416b-8269-872f4c56822b service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Received event network-vif-plugged-9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-71918b67-8d5f-4f5e-b217-d53110764cb7 req-e160e533-efcc-416b-8269-872f4c56822b service nova] Acquiring lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-71918b67-8d5f-4f5e-b217-d53110764cb7 req-e160e533-efcc-416b-8269-872f4c56822b service nova] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-71918b67-8d5f-4f5e-b217-d53110764cb7 req-e160e533-efcc-416b-8269-872f4c56822b service nova] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:29 user nova-compute[75018]: DEBUG nova.compute.manager [req-71918b67-8d5f-4f5e-b217-d53110764cb7 req-e160e533-efcc-416b-8269-872f4c56822b service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] No waiting events found dispatching network-vif-plugged-9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:21:29 user nova-compute[75018]: WARNING nova.compute.manager [req-71918b67-8d5f-4f5e-b217-d53110764cb7 req-e160e533-efcc-416b-8269-872f4c56822b service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Received unexpected event network-vif-plugged-9fcc5742-dd8b-4205-be25-c16830b915a4 for instance with vm_state building and task_state spawning.
Nov 07 15:21:29 user nova-compute[75018]: INFO nova.compute.manager [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Took 6.80 seconds to build instance.
Nov 07 15:21:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ab534217-68b8-491e-8d72-f80f29a0d4bf tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.932s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "5212605c-c913-483f-874b-17af335aeb2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "5212605c-c913-483f-874b-17af335aeb2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:21:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:21:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:21:46 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:21:46 user nova-compute[75018]: INFO nova.compute.claims [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Claim successful on node user
Nov 07 15:21:46 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:21:46 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:21:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:21:46 user nova-compute[75018]: DEBUG nova.compute.manager [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:21:46 user nova-compute[75018]: DEBUG nova.compute.manager [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:21:46 user nova-compute[75018]: DEBUG nova.network.neutron [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:21:46 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:21:46 user nova-compute[75018]: DEBUG nova.compute.manager [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:21:46 user nova-compute[75018]: DEBUG nova.policy [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa101c0dd31f4796803bf3b600e5b439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abdb560dcda4650a47cc53ae59c9783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:21:46 user nova-compute[75018]: INFO nova.virt.block_device [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Booting with volume cd6809db-5bfd-4f25-a699-665747ec0582 at /dev/vda
Nov 07 15:21:46 user nova-compute[75018]: DEBUG os_brick.utils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:21:46 user nova-compute[75018]: INFO oslo.privsep.daemon [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpmopcod9w/privsep.sock']
Nov 07 15:21:46 user sudo[86124]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpmopcod9w/privsep.sock
Nov 07 15:21:46 user sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 07 15:21:47 user nova-compute[75018]: DEBUG nova.network.neutron [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Successfully created port: 57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:21:47 user nova-compute[75018]: DEBUG nova.network.neutron [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Successfully updated port: 57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:21:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "refresh_cache-5212605c-c913-483f-874b-17af335aeb2f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:21:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquired lock "refresh_cache-5212605c-c913-483f-874b-17af335aeb2f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:21:47 user nova-compute[75018]: DEBUG nova.network.neutron [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:21:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-bd191803-ff80-441a-ab31-d33f1b505d05 req-57864c82-c0d7-4400-8f51-e3c0d0a0b960 service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Received event network-changed-57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:21:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-bd191803-ff80-441a-ab31-d33f1b505d05 req-57864c82-c0d7-4400-8f51-e3c0d0a0b960 service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Refreshing instance network info cache due to event network-changed-57d57fc6-3705-4b40-9d00-44c182114a8a. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:21:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-bd191803-ff80-441a-ab31-d33f1b505d05 req-57864c82-c0d7-4400-8f51-e3c0d0a0b960 service nova] Acquiring lock "refresh_cache-5212605c-c913-483f-874b-17af335aeb2f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:21:47 user nova-compute[75018]: DEBUG nova.network.neutron [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG nova.network.neutron [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Updating instance_info_cache with network_info: [{"id": "57d57fc6-3705-4b40-9d00-44c182114a8a", "address": "fa:16:3e:90:c3:82", "network": {"id": "10ccf061-c522-4a5b-ba65-4d89ef2fb661", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-853530484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abdb560dcda4650a47cc53ae59c9783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d57fc6-37", "ovs_interfaceid": "57d57fc6-3705-4b40-9d00-44c182114a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Releasing lock "refresh_cache-5212605c-c913-483f-874b-17af335aeb2f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG nova.compute.manager [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Instance network_info: |[{"id": "57d57fc6-3705-4b40-9d00-44c182114a8a", "address": "fa:16:3e:90:c3:82", "network": {"id": "10ccf061-c522-4a5b-ba65-4d89ef2fb661", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-853530484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abdb560dcda4650a47cc53ae59c9783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d57fc6-37", "ovs_interfaceid": "57d57fc6-3705-4b40-9d00-44c182114a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-bd191803-ff80-441a-ab31-d33f1b505d05 req-57864c82-c0d7-4400-8f51-e3c0d0a0b960 service nova] Acquired lock "refresh_cache-5212605c-c913-483f-874b-17af335aeb2f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG nova.network.neutron [req-bd191803-ff80-441a-ab31-d33f1b505d05 req-57864c82-c0d7-4400-8f51-e3c0d0a0b960 service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Refreshing network info cache for port 57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:21:48 user sudo[86124]: pam_unix(sudo:session): session closed for user root
Nov 07 15:21:48 user nova-compute[75018]: INFO oslo.privsep.daemon [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Spawned new privsep daemon via rootwrap
Nov 07 15:21:48 user nova-compute[75018]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 07 15:21:48 user nova-compute[75018]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 07 15:21:48 user nova-compute[75018]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 07 15:21:48 user nova-compute[75018]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86127
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1bc549-bad6-42ec-b3ae-9ac3ee16d7cb]: (2,) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG nova.network.neutron [req-bd191803-ff80-441a-ab31-d33f1b505d05 req-57864c82-c0d7-4400-8f51-e3c0d0a0b960 service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Updated VIF entry in instance network info cache for port 57d57fc6-3705-4b40-9d00-44c182114a8a. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG nova.network.neutron [req-bd191803-ff80-441a-ab31-d33f1b505d05 req-57864c82-c0d7-4400-8f51-e3c0d0a0b960 service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Updating instance_info_cache with network_info: [{"id": "57d57fc6-3705-4b40-9d00-44c182114a8a", "address": "fa:16:3e:90:c3:82", "network": {"id": "10ccf061-c522-4a5b-ba65-4d89ef2fb661", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-853530484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abdb560dcda4650a47cc53ae59c9783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d57fc6-37", "ovs_interfaceid": "57d57fc6-3705-4b40-9d00-44c182114a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-bd191803-ff80-441a-ab31-d33f1b505d05 req-57864c82-c0d7-4400-8f51-e3c0d0a0b960 service nova] Releasing lock "refresh_cache-5212605c-c913-483f-874b-17af335aeb2f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c18b605-9f23-46d3-8e43-26eaf9a84c74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:21:48 user nova-compute[75018]: WARNING os_brick.initiator.connectors.nvmeof [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e8674e-e83a-47f1-b8f8-3a741cad8eac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[124f0587-1a39-4fdb-ab90-96891e10cc18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[56666297-17cc-4715-9553-a9fde29eee86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:21:48 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:21:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb3b3dc-2f53-43fb-8ec9-6322d6fc02c1]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG os_brick.utils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] <== get_connector_properties: return (1948ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:21:48 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Updating existing volume attachment record: 307d6b5f-de46-42bf-8bc2-48e8fcde99cc {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:21:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:21:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.compute.manager [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:22:10 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Creating image(s)
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Did not create local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Ensure instance console log exists: /opt/stack/data/nova/instances/5212605c-c913-483f-874b-17af335aeb2f/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Start _get_guest_xml network_info=[{"id": "57d57fc6-3705-4b40-9d00-44c182114a8a", "address": "fa:16:3e:90:c3:82", "network": {"id": "10ccf061-c522-4a5b-ba65-4d89ef2fb661", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-853530484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abdb560dcda4650a47cc53ae59c9783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d57fc6-37", "ovs_interfaceid": "57d57fc6-3705-4b40-9d00-44c182114a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWNgZhKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5212605c-c913-483f-874b-17af335aeb2f', 'attached_at': '', 'detached_at': '', 'volume_id': 'cd6809db-5bfd-4f25-a699-665747ec0582', 'serial': 'cd6809db-5bfd-4f25-a699-665747ec0582'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '307d6b5f-de46-42bf-8bc2-48e8fcde99cc', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:22:10 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:22:10 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connector [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Factory for ISCSI on None {{(pid=75018) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWNgZhKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:22:10 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.009s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:22:10 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:22:10 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4961d29f-8847-4fc6-ba5a-5f5e8eb2fdea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:22:10 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[984cdad4-d702-4022-9888-b8934158a110]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582] added
Nov 07 15:22:10 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb67634-b56c-4a94-9644-b58c76ef45c3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d574f0-a1f7-4c8a-a15f-4cfe16bcaebc]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HWNgZhKv {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HWNgZhKv" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9905eb-f710-4f41-87d8-05143dc37fd0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HWNgZhKv'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[68df567b-9445-4683-a744-934dde1615b1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f391d5df-180b-4fcb-b8ab-d770be4aa04a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 15:22:10 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 15:22:10 user nova-compute[75018]:  {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:22:10 user nova-compute[75018]: WARNING os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 15:22:10 user nova-compute[75018]: 
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[306bce31-7d4d-4252-a1e9-c9019924f69c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582, portal: 172.16.0.220,3260]
Nov 07 15:22:10 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582, portal: 172.16.0.220,3260] successful.
Nov 07 15:22:10 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c355879a-3ae6-4d7e-86dd-7770627d39d3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b46b46c-5192-4a9e-91c6-7b3c0f0a0cfe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:22:10 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:22:10 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f96193-e8a5-41e7-81ae-3b590dfa49a6]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWNgZhKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:22:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26138626461343561', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138626461343561', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-655130991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-655130991',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPv8aFD5LWaVVjpuImyl8D4RlPV5xNYVN7NKvQFHB8zaOHQSYdricv6FD20zXu/XqDM3rUoyy7wL0y3axEvbla/s7QURGC98f2Y4d2r6/lV5ouvT8UGE1tcxwINR8RXzg==',key_name='tempest-keypair-2093191890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5abdb560dcda4650a47cc53ae59c9783',ramdisk_id='',reservation_id='r-acj23alz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1927257890',owner_user_name='tempest-ServerActionsV293TestJSON-1927257890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:21:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa101c0dd31f4796803bf3b600e5b439',uuid=5212605c-c913-483f-874b-17af335aeb2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57d57fc6-3705-4b40-9d00-44c182114a8a", "address": "fa:16:3e:90:c3:82", "network": {"id": "10ccf061-c522-4a5b-ba65-4d89ef2fb661", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-853530484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abdb560dcda4650a47cc53ae59c9783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d57fc6-37", "ovs_interfaceid": "57d57fc6-3705-4b40-9d00-44c182114a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Converting VIF {"id": "57d57fc6-3705-4b40-9d00-44c182114a8a", "address": "fa:16:3e:90:c3:82", "network": {"id": "10ccf061-c522-4a5b-ba65-4d89ef2fb661", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-853530484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abdb560dcda4650a47cc53ae59c9783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d57fc6-37", "ovs_interfaceid": "57d57fc6-3705-4b40-9d00-44c182114a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:c3:82,bridge_name='br-int',has_traffic_filtering=True,id=57d57fc6-3705-4b40-9d00-44c182114a8a,network=Network(10ccf061-c522-4a5b-ba65-4d89ef2fb661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d57fc6-37') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG nova.objects.instance [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lazy-loading 'pci_devices' on Instance uuid 5212605c-c913-483f-874b-17af335aeb2f {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:22:11 user nova-compute[75018]:   <uuid>5212605c-c913-483f-874b-17af335aeb2f</uuid>
Nov 07 15:22:11 user nova-compute[75018]:   <name>instance-0000000a</name>
Nov 07 15:22:11 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:22:11 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:22:11 user nova-compute[75018]:   <metadata>
Nov 07 15:22:11 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:22:11 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:22:11 user nova-compute[75018]:       <nova:name>tempest-ServerActionsV293TestJSON-server-655130991</nova:name>
Nov 07 15:22:11 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:22:10</nova:creationTime>
Nov 07 15:22:11 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:22:11 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:22:11 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:22:11 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:22:11 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:22:11 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:22:11 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:22:11 user nova-compute[75018]:       <nova:owner>
Nov 07 15:22:11 user nova-compute[75018]:         <nova:user uuid="aa101c0dd31f4796803bf3b600e5b439">tempest-ServerActionsV293TestJSON-1927257890-project-member</nova:user>
Nov 07 15:22:11 user nova-compute[75018]:         <nova:project uuid="5abdb560dcda4650a47cc53ae59c9783">tempest-ServerActionsV293TestJSON-1927257890</nova:project>
Nov 07 15:22:11 user nova-compute[75018]:       </nova:owner>
Nov 07 15:22:11 user nova-compute[75018]:       <nova:ports>
Nov 07 15:22:11 user nova-compute[75018]:         <nova:port uuid="57d57fc6-3705-4b40-9d00-44c182114a8a">
Nov 07 15:22:11 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 07 15:22:11 user nova-compute[75018]:         </nova:port>
Nov 07 15:22:11 user nova-compute[75018]:       </nova:ports>
Nov 07 15:22:11 user nova-compute[75018]:     </nova:instance>
Nov 07 15:22:11 user nova-compute[75018]:   </metadata>
Nov 07 15:22:11 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:22:11 user nova-compute[75018]:     <system>
Nov 07 15:22:11 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:22:11 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:22:11 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:22:11 user nova-compute[75018]:       <entry name="serial">5212605c-c913-483f-874b-17af335aeb2f</entry>
Nov 07 15:22:11 user nova-compute[75018]:       <entry name="uuid">5212605c-c913-483f-874b-17af335aeb2f</entry>
Nov 07 15:22:11 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:22:11 user nova-compute[75018]:     </system>
Nov 07 15:22:11 user nova-compute[75018]:   </sysinfo>
Nov 07 15:22:11 user nova-compute[75018]:   <os>
Nov 07 15:22:11 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:22:11 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:22:11 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:22:11 user nova-compute[75018]:   </os>
Nov 07 15:22:11 user nova-compute[75018]:   <features>
Nov 07 15:22:11 user nova-compute[75018]:     <acpi/>
Nov 07 15:22:11 user nova-compute[75018]:     <apic/>
Nov 07 15:22:11 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:22:11 user nova-compute[75018]:   </features>
Nov 07 15:22:11 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:22:11 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:22:11 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:22:11 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:22:11 user nova-compute[75018]:   </clock>
Nov 07 15:22:11 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:22:11 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:22:11 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:22:11 user nova-compute[75018]:   </cpu>
Nov 07 15:22:11 user nova-compute[75018]:   <devices>
Nov 07 15:22:11 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:22:11 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:22:11 user nova-compute[75018]:       <source dev="/dev/sdb"/>
Nov 07 15:22:11 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:22:11 user nova-compute[75018]:       <serial>cd6809db-5bfd-4f25-a699-665747ec0582</serial>
Nov 07 15:22:11 user nova-compute[75018]:     </disk>
Nov 07 15:22:11 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:22:11 user nova-compute[75018]:       <mac address="fa:16:3e:90:c3:82"/>
Nov 07 15:22:11 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:22:11 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:22:11 user nova-compute[75018]:       <target dev="tap57d57fc6-37"/>
Nov 07 15:22:11 user nova-compute[75018]:     </interface>
Nov 07 15:22:11 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:22:11 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/5212605c-c913-483f-874b-17af335aeb2f/console.log" append="off"/>
Nov 07 15:22:11 user nova-compute[75018]:     </serial>
Nov 07 15:22:11 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:22:11 user nova-compute[75018]:     <video>
Nov 07 15:22:11 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:22:11 user nova-compute[75018]:     </video>
Nov 07 15:22:11 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:22:11 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:22:11 user nova-compute[75018]:     </rng>
Nov 07 15:22:11 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:22:11 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:22:11 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:22:11 user nova-compute[75018]:     </memballoon>
Nov 07 15:22:11 user nova-compute[75018]:   </devices>
Nov 07 15:22:11 user nova-compute[75018]: </domain>
Nov 07 15:22:11 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-655130991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-655130991',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPv8aFD5LWaVVjpuImyl8D4RlPV5xNYVN7NKvQFHB8zaOHQSYdricv6FD20zXu/XqDM3rUoyy7wL0y3axEvbla/s7QURGC98f2Y4d2r6/lV5ouvT8UGE1tcxwINR8RXzg==',key_name='tempest-keypair-2093191890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5abdb560dcda4650a47cc53ae59c9783',ramdisk_id='',reservation_id='r-acj23alz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1927257890',owner_user_name='tempest-ServerActionsV293TestJSON-1927257890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:21:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa101c0dd31f4796803bf3b600e5b439',uuid=5212605c-c913-483f-874b-17af335aeb2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57d57fc6-3705-4b40-9d00-44c182114a8a", "address": "fa:16:3e:90:c3:82", "network": {"id": "10ccf061-c522-4a5b-ba65-4d89ef2fb661", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-853530484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abdb560dcda4650a47cc53ae59c9783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d57fc6-37", "ovs_interfaceid": "57d57fc6-3705-4b40-9d00-44c182114a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Converting VIF {"id": "57d57fc6-3705-4b40-9d00-44c182114a8a", "address": "fa:16:3e:90:c3:82", "network": {"id": "10ccf061-c522-4a5b-ba65-4d89ef2fb661", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-853530484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abdb560dcda4650a47cc53ae59c9783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d57fc6-37", "ovs_interfaceid": "57d57fc6-3705-4b40-9d00-44c182114a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:c3:82,bridge_name='br-int',has_traffic_filtering=True,id=57d57fc6-3705-4b40-9d00-44c182114a8a,network=Network(10ccf061-c522-4a5b-ba65-4d89ef2fb661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d57fc6-37') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG os_vif [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c3:82,bridge_name='br-int',has_traffic_filtering=True,id=57d57fc6-3705-4b40-9d00-44c182114a8a,network=Network(10ccf061-c522-4a5b-ba65-4d89ef2fb661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d57fc6-37') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74ac76a1-ba8f-5a09-babc-1d46efdb86da', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57d57fc6-37, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57d57fc6-37, col_values=(('qos', UUID('ee079849-ffa0-4818-a8ff-3e04ab57e2bb')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57d57fc6-37, col_values=(('external_ids', {'iface-id': '57d57fc6-3705-4b40-9d00-44c182114a8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:c3:82', 'vm-uuid': '5212605c-c913-483f-874b-17af335aeb2f'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:11 user nova-compute[75018]: INFO os_vif [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c3:82,bridge_name='br-int',has_traffic_filtering=True,id=57d57fc6-3705-4b40-9d00-44c182114a8a,network=Network(10ccf061-c522-4a5b-ba65-4d89ef2fb661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d57fc6-37')
Nov 07 15:22:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] No VIF found with MAC fa:16:3e:90:c3:82, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-72eb566d-bd9b-43e8-af0f-97d9a4e1d652 req-9c28433d-d930-4e39-8b21-846c62f691bb service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Received event network-vif-plugged-57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-72eb566d-bd9b-43e8-af0f-97d9a4e1d652 req-9c28433d-d930-4e39-8b21-846c62f691bb service nova] Acquiring lock "5212605c-c913-483f-874b-17af335aeb2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-72eb566d-bd9b-43e8-af0f-97d9a4e1d652 req-9c28433d-d930-4e39-8b21-846c62f691bb service nova] Lock "5212605c-c913-483f-874b-17af335aeb2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-72eb566d-bd9b-43e8-af0f-97d9a4e1d652 req-9c28433d-d930-4e39-8b21-846c62f691bb service nova] Lock "5212605c-c913-483f-874b-17af335aeb2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-72eb566d-bd9b-43e8-af0f-97d9a4e1d652 req-9c28433d-d930-4e39-8b21-846c62f691bb service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] No waiting events found dispatching network-vif-plugged-57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:22:13 user nova-compute[75018]: WARNING nova.compute.manager [req-72eb566d-bd9b-43e8-af0f-97d9a4e1d652 req-9c28433d-d930-4e39-8b21-846c62f691bb service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Received unexpected event network-vif-plugged-57d57fc6-3705-4b40-9d00-44c182114a8a for instance with vm_state building and task_state spawning.
Nov 07 15:22:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:22:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:22:14 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Instance spawned successfully.
Nov 07 15:22:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:22:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:22:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:22:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:22:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:22:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:22:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:22:14 user nova-compute[75018]: INFO nova.compute.manager [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 07 15:22:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:22:15 user nova-compute[75018]: INFO nova.compute.manager [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Took 29.06 seconds to build instance.
Nov 07 15:22:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-634c1451-9e40-4e9a-a34c-c8f439c51857 tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "5212605c-c913-483f-874b-17af335aeb2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.154s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:15 user nova-compute[75018]: DEBUG nova.compute.manager [req-e459da9d-8238-4a66-b112-9b67febc17be req-1bcfa8c7-fdf8-491e-b17a-9e8f7558e52a service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Received event network-vif-plugged-57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e459da9d-8238-4a66-b112-9b67febc17be req-1bcfa8c7-fdf8-491e-b17a-9e8f7558e52a service nova] Acquiring lock "5212605c-c913-483f-874b-17af335aeb2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e459da9d-8238-4a66-b112-9b67febc17be req-1bcfa8c7-fdf8-491e-b17a-9e8f7558e52a service nova] Lock "5212605c-c913-483f-874b-17af335aeb2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e459da9d-8238-4a66-b112-9b67febc17be req-1bcfa8c7-fdf8-491e-b17a-9e8f7558e52a service nova] Lock "5212605c-c913-483f-874b-17af335aeb2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:15 user nova-compute[75018]: DEBUG nova.compute.manager [req-e459da9d-8238-4a66-b112-9b67febc17be req-1bcfa8c7-fdf8-491e-b17a-9e8f7558e52a service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] No waiting events found dispatching network-vif-plugged-57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:22:15 user nova-compute[75018]: WARNING nova.compute.manager [req-e459da9d-8238-4a66-b112-9b67febc17be req-1bcfa8c7-fdf8-491e-b17a-9e8f7558e52a service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Received unexpected event network-vif-plugged-57d57fc6-3705-4b40-9d00-44c182114a8a for instance with vm_state active and task_state None.
Nov 07 15:22:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:22:16 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:22:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-f7a7a0f7-d75b-44bd-8e6f-702a118518af req-3a4f5e08-2999-4c2c-a3ef-3f6048582ed4 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received event network-changed-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-f7a7a0f7-d75b-44bd-8e6f-702a118518af req-3a4f5e08-2999-4c2c-a3ef-3f6048582ed4 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Refreshing instance network info cache due to event network-changed-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f7a7a0f7-d75b-44bd-8e6f-702a118518af req-3a4f5e08-2999-4c2c-a3ef-3f6048582ed4 service nova] Acquiring lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f7a7a0f7-d75b-44bd-8e6f-702a118518af req-3a4f5e08-2999-4c2c-a3ef-3f6048582ed4 service nova] Acquired lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:16 user nova-compute[75018]: DEBUG nova.network.neutron [req-f7a7a0f7-d75b-44bd-8e6f-702a118518af req-3a4f5e08-2999-4c2c-a3ef-3f6048582ed4 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Refreshing network info cache for port d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:22:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:22:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:22:17 user nova-compute[75018]: DEBUG nova.network.neutron [req-f7a7a0f7-d75b-44bd-8e6f-702a118518af req-3a4f5e08-2999-4c2c-a3ef-3f6048582ed4 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updated VIF entry in instance network info cache for port d7fccd97-1db7-4dac-b2e9-6d5b4004aa70. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:22:17 user nova-compute[75018]: DEBUG nova.network.neutron [req-f7a7a0f7-d75b-44bd-8e6f-702a118518af req-3a4f5e08-2999-4c2c-a3ef-3f6048582ed4 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updating instance_info_cache with network_info: [{"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f7a7a0f7-d75b-44bd-8e6f-702a118518af req-3a4f5e08-2999-4c2c-a3ef-3f6048582ed4 service nova] Releasing lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:17 user nova-compute[75018]: DEBUG nova.compute.manager [req-fbd32b60-6c9e-4ca7-ae81-be328734bc40 req-f085334c-7419-4685-9c20-8251f806ebb5 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-changed-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:17 user nova-compute[75018]: DEBUG nova.compute.manager [req-fbd32b60-6c9e-4ca7-ae81-be328734bc40 req-f085334c-7419-4685-9c20-8251f806ebb5 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Refreshing instance network info cache due to event network-changed-05429ce8-06b2-4693-bf2c-5d03a4343e00. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fbd32b60-6c9e-4ca7-ae81-be328734bc40 req-f085334c-7419-4685-9c20-8251f806ebb5 service nova] Acquiring lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fbd32b60-6c9e-4ca7-ae81-be328734bc40 req-f085334c-7419-4685-9c20-8251f806ebb5 service nova] Acquired lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:17 user nova-compute[75018]: DEBUG nova.network.neutron [req-fbd32b60-6c9e-4ca7-ae81-be328734bc40 req-f085334c-7419-4685-9c20-8251f806ebb5 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Refreshing network info cache for port 05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:18 user nova-compute[75018]: DEBUG nova.network.neutron [req-fbd32b60-6c9e-4ca7-ae81-be328734bc40 req-f085334c-7419-4685-9c20-8251f806ebb5 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updated VIF entry in instance network info cache for port 05429ce8-06b2-4693-bf2c-5d03a4343e00. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:22:18 user nova-compute[75018]: DEBUG nova.network.neutron [req-fbd32b60-6c9e-4ca7-ae81-be328734bc40 req-f085334c-7419-4685-9c20-8251f806ebb5 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating instance_info_cache with network_info: [{"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fbd32b60-6c9e-4ca7-ae81-be328734bc40 req-f085334c-7419-4685-9c20-8251f806ebb5 service nova] Releasing lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:18 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:22:18 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:22:18 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:22:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:18 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:22:19 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updating instance_info_cache with network_info: [{"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:19 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:22:19 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:22:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:19 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:22:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.445s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lazy-loading 'flavor' on Instance uuid b8d3da3e-3927-4f4e-b9a3-994d45d5a408 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:22:22 user nova-compute[75018]: DEBUG nova.compute.manager [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:22:23 user nova-compute[75018]: INFO nova.compute.claims [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Claim successful on node user
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:23 user nova-compute[75018]: INFO nova.compute.manager [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Attaching volume 9eb6ad90-697c-4f72-8942-a03dd21ee8af to /dev/vdb
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG os_brick.utils [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fab2257-ff01-4cf6-9d4e-9484835b00a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6140fa09-0c2c-4501-82e0-40d287b33e66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50ca83b-260d-4f88-8393-8b6c14bc2fbd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d8194b-c9ab-40c1-a034-bb689c8b0365]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:22:23 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7851c984-8e1c-47f2-bf77-c3a23d0e00e4]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG os_brick.utils [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Updating existing volume attachment record: c5c6f4fd-b6ce-4e45-bcfc-46186977d525 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:22:23 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:22:23 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:22:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7153MB free_disk=25.397167205810547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.054s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.manager [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.201s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.manager [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:22:24 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8257c590-204a-4fde-8487-79b8c0c87ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance eb712362-b6b8-4a19-8f5b-8c374d6c4d87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance b8d3da3e-3927-4f4e-b9a3-994d45d5a408 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 569b9815-efc4-46d0-832e-9931fdd7d6ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e3abd70e-baf7-4f13-832c-43696a5ea80c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 22422ecc-1027-41c5-9bea-066fdc8ca995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance d5341681-9ba6-4f21-a67c-00d50aea8762 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 5212605c-c913-483f-874b-17af335aeb2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 934e9b7f-8bb4-4487-83cd-c5fbc92daefc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 44f8bf0d-9714-45cf-8f71-206a8bb75a3a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.manager [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:22:24 user nova-compute[75018]: INFO nova.virt.block_device [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Booting with volume e9e83453-bfee-4260-986f-6df2d7963867 at /dev/vda
Nov 07 15:22:24 user nova-compute[75018]: DEBUG os_brick.utils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.policy [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b3cbd57eebe4bba85843cc4608ec75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe38e9e3e1d24bb3b3b8b910b1de52ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8aafd0-15d6-4422-9ebf-04af07471094]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67f0d2c-586d-4ead-a737-5bf0ba87bf2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea02f083-b690-4232-88c5-48d93b45307a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f325f217-ec10-4e3c-ab7f-e0781c16b7d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:22:24 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[137bc6c6-c11c-46c0-93b9-137953a4a134]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG os_brick.utils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updating existing volume attachment record: 1bc47b9d-c590-40a8-b9a2-125457bd981a {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.787s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:24 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:22:24 user nova-compute[75018]: INFO nova.compute.claims [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Claim successful on node user
Nov 07 15:22:25 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Successfully created port: 82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:25 user nova-compute[75018]: INFO nova.compute.manager [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Shelving
Nov 07 15:22:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:22:25 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:22:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:25 user nova-compute[75018]: INFO nova.virt.block_device [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Booting with volume 52a3ccb9-d419-4301-b804-fb5c6a8e4042 at /dev/vda
Nov 07 15:22:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG os_brick.utils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG nova.policy [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac6aff2e0eae4806bb862abfb9f31d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9973265f38de417c9af4de9eb09ce262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed7eb06-40e8-4635-a9cb-de81a0b8c9dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c954ba53-4128-478c-9edb-2bff77f2de19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b976c833-f865-4d65-8332-da51e84f05ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[921a62c7-ac70-44a1-874b-5cbfb5b305eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-967bbad1-f695-4022-8e46-e09a7ff8d493 req-6aa7b3e1-bc6b-4428-a2b7-56c9aeb65c6a service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received event network-vif-unplugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-967bbad1-f695-4022-8e46-e09a7ff8d493 req-6aa7b3e1-bc6b-4428-a2b7-56c9aeb65c6a service nova] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-967bbad1-f695-4022-8e46-e09a7ff8d493 req-6aa7b3e1-bc6b-4428-a2b7-56c9aeb65c6a service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-967bbad1-f695-4022-8e46-e09a7ff8d493 req-6aa7b3e1-bc6b-4428-a2b7-56c9aeb65c6a service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-967bbad1-f695-4022-8e46-e09a7ff8d493 req-6aa7b3e1-bc6b-4428-a2b7-56c9aeb65c6a service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] No waiting events found dispatching network-vif-unplugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:22:25 user nova-compute[75018]: WARNING nova.compute.manager [req-967bbad1-f695-4022-8e46-e09a7ff8d493 req-6aa7b3e1-bc6b-4428-a2b7-56c9aeb65c6a service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received unexpected event network-vif-unplugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 for instance with vm_state active and task_state shelving.
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:22:25 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:22:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91e2406-5c2e-418e-a6a6-82a188606016]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Successfully created port: f7d8a867-7f2c-4f73-8521-b2ec3f646045 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG os_brick.utils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:22:25 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating existing volume attachment record: e8f04df6-2f15-4ba2-9b8e-2468516ad6c9 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:22:26 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Instance destroyed successfully.
Nov 07 15:22:26 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Successfully created port: e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:22:26 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Beginning cold snapshot process
Nov 07 15:22:26 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Successfully created port: 73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:22:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:26 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:22:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk /opt/stack/data/nova/instances/snapshots/tmpa_p3on90/279b24835cc4458db6164a209fd68cb4 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:26 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Successfully created port: 5a2e7ee9-58c4-46e3-8f31-961dfb488150 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:22:27 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Successfully created port: af3cc600-3a36-42ec-8976-b1c950150d96 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:22:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk /opt/stack/data/nova/instances/snapshots/tmpa_p3on90/279b24835cc4458db6164a209fd68cb4" returned: 0 in 0.794s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:27 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Snapshot extracted, beginning image upload
Nov 07 15:22:27 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Successfully created port: 0961679c-4367-4cb0-b7f8-b763408f97c6 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:22:27 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Successfully created port: c265f2ff-01fc-4405-81dc-7612ee11764e {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:22:27 user nova-compute[75018]: DEBUG nova.compute.manager [req-17a85656-5ef1-4c28-83b2-c419586bc9bc req-39e0dbcc-7bff-4706-8c52-677276ee5dee service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received event network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-17a85656-5ef1-4c28-83b2-c419586bc9bc req-39e0dbcc-7bff-4706-8c52-677276ee5dee service nova] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-17a85656-5ef1-4c28-83b2-c419586bc9bc req-39e0dbcc-7bff-4706-8c52-677276ee5dee service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-17a85656-5ef1-4c28-83b2-c419586bc9bc req-39e0dbcc-7bff-4706-8c52-677276ee5dee service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:27 user nova-compute[75018]: DEBUG nova.compute.manager [req-17a85656-5ef1-4c28-83b2-c419586bc9bc req-39e0dbcc-7bff-4706-8c52-677276ee5dee service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] No waiting events found dispatching network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:22:27 user nova-compute[75018]: WARNING nova.compute.manager [req-17a85656-5ef1-4c28-83b2-c419586bc9bc req-39e0dbcc-7bff-4706-8c52-677276ee5dee service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received unexpected event network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 for instance with vm_state active and task_state shelving_image_uploading.
Nov 07 15:22:28 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Successfully created port: da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:22:28 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Successfully updated port: 82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-6bf89832-c73d-4133-9a88-fc61516d2db1 req-8f7c718d-bdb7-4e38-a696-6869105140b3 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-changed-82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-6bf89832-c73d-4133-9a88-fc61516d2db1 req-8f7c718d-bdb7-4e38-a696-6869105140b3 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing instance network info cache due to event network-changed-82c43c00-84c9-470a-b788-2372caaad4b2. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6bf89832-c73d-4133-9a88-fc61516d2db1 req-8f7c718d-bdb7-4e38-a696-6869105140b3 service nova] Acquiring lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6bf89832-c73d-4133-9a88-fc61516d2db1 req-8f7c718d-bdb7-4e38-a696-6869105140b3 service nova] Acquired lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:28 user nova-compute[75018]: DEBUG nova.network.neutron [req-6bf89832-c73d-4133-9a88-fc61516d2db1 req-8f7c718d-bdb7-4e38-a696-6869105140b3 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing network info cache for port 82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:28 user nova-compute[75018]: DEBUG nova.network.neutron [req-6bf89832-c73d-4133-9a88-fc61516d2db1 req-8f7c718d-bdb7-4e38-a696-6869105140b3 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:22:29 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Successfully updated port: 17ab878f-bcba-42bf-a4ed-15517fa5e244 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:29 user nova-compute[75018]: DEBUG nova.network.neutron [req-6bf89832-c73d-4133-9a88-fc61516d2db1 req-8f7c718d-bdb7-4e38-a696-6869105140b3 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6bf89832-c73d-4133-9a88-fc61516d2db1 req-8f7c718d-bdb7-4e38-a696-6869105140b3 service nova] Releasing lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:29 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Successfully created port: 106cd061-e91b-4718-8c52-cbaf14defe8c {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:22:29 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Successfully updated port: 56f2d51d-5593-464f-b7da-df1c81449a23 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:29 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Successfully updated port: 73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-05a7fde7-3869-48e6-99e7-e592282a0f8e req-b4a77c15-5a77-4e51-8edc-21e84c91c4ba service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-changed-73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-05a7fde7-3869-48e6-99e7-e592282a0f8e req-b4a77c15-5a77-4e51-8edc-21e84c91c4ba service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing instance network info cache due to event network-changed-73054878-c401-487b-8a75-1a637723b058. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-05a7fde7-3869-48e6-99e7-e592282a0f8e req-b4a77c15-5a77-4e51-8edc-21e84c91c4ba service nova] Acquiring lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-05a7fde7-3869-48e6-99e7-e592282a0f8e req-b4a77c15-5a77-4e51-8edc-21e84c91c4ba service nova] Acquired lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:30 user nova-compute[75018]: DEBUG nova.network.neutron [req-05a7fde7-3869-48e6-99e7-e592282a0f8e req-b4a77c15-5a77-4e51-8edc-21e84c91c4ba service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing network info cache for port 73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:30 user nova-compute[75018]: DEBUG nova.network.neutron [req-05a7fde7-3869-48e6-99e7-e592282a0f8e req-b4a77c15-5a77-4e51-8edc-21e84c91c4ba service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:22:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-changed-17ab878f-bcba-42bf-a4ed-15517fa5e244 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing instance network info cache due to event network-changed-17ab878f-bcba-42bf-a4ed-15517fa5e244. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] Acquiring lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] Acquired lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:30 user nova-compute[75018]: DEBUG nova.network.neutron [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing network info cache for port 17ab878f-bcba-42bf-a4ed-15517fa5e244 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:30 user nova-compute[75018]: DEBUG nova.network.neutron [req-05a7fde7-3869-48e6-99e7-e592282a0f8e req-b4a77c15-5a77-4e51-8edc-21e84c91c4ba service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-05a7fde7-3869-48e6-99e7-e592282a0f8e req-b4a77c15-5a77-4e51-8edc-21e84c91c4ba service nova] Releasing lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:30 user nova-compute[75018]: DEBUG nova.network.neutron [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG nova.network.neutron [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] Releasing lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG nova.compute.manager [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-changed-56f2d51d-5593-464f-b7da-df1c81449a23 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG nova.compute.manager [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing instance network info cache due to event network-changed-56f2d51d-5593-464f-b7da-df1c81449a23. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] Acquiring lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] Acquired lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG nova.network.neutron [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing network info cache for port 56f2d51d-5593-464f-b7da-df1c81449a23 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG nova.network.neutron [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Successfully updated port: 98461dfb-9088-430a-bf24-dd855ff7175b {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG nova.network.neutron [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e42a75a1-5fd9-4d67-9f02-2e20598efe69 req-6913b636-caed-4db7-bf76-878544312755 service nova] Releasing lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Successfully updated port: f7d8a867-7f2c-4f73-8521-b2ec3f646045 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:22:31 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Snapshot image upload complete
Nov 07 15:22:31 user nova-compute[75018]: DEBUG nova.compute.manager [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:22:31 user nova-compute[75018]: INFO nova.compute.manager [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Shelve offloading
Nov 07 15:22:31 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Instance destroyed successfully.
Nov 07 15:22:31 user nova-compute[75018]: DEBUG nova.compute.manager [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquired lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG nova.network.neutron [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:22:31 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Successfully updated port: d1383062-7e89-4ca1-a140-27490e36d621 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-05158395-ad21-4375-808f-4a7b40915434 req-376a2b61-32b2-4742-8cac-4bbb3c611d8d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-changed-f7d8a867-7f2c-4f73-8521-b2ec3f646045 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-05158395-ad21-4375-808f-4a7b40915434 req-376a2b61-32b2-4742-8cac-4bbb3c611d8d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing instance network info cache due to event network-changed-f7d8a867-7f2c-4f73-8521-b2ec3f646045. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-05158395-ad21-4375-808f-4a7b40915434 req-376a2b61-32b2-4742-8cac-4bbb3c611d8d service nova] Acquiring lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-05158395-ad21-4375-808f-4a7b40915434 req-376a2b61-32b2-4742-8cac-4bbb3c611d8d service nova] Acquired lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-05158395-ad21-4375-808f-4a7b40915434 req-376a2b61-32b2-4742-8cac-4bbb3c611d8d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing network info cache for port f7d8a867-7f2c-4f73-8521-b2ec3f646045 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-05158395-ad21-4375-808f-4a7b40915434 req-376a2b61-32b2-4742-8cac-4bbb3c611d8d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-05158395-ad21-4375-808f-4a7b40915434 req-376a2b61-32b2-4742-8cac-4bbb3c611d8d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-05158395-ad21-4375-808f-4a7b40915434 req-376a2b61-32b2-4742-8cac-4bbb3c611d8d service nova] Releasing lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Successfully updated port: e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG nova.network.neutron [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updating instance_info_cache with network_info: [{"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-changed-98461dfb-9088-430a-bf24-dd855ff7175b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing instance network info cache due to event network-changed-98461dfb-9088-430a-bf24-dd855ff7175b. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] Acquiring lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] Acquired lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing network info cache for port 98461dfb-9088-430a-bf24-dd855ff7175b {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Releasing lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Successfully updated port: 5a2e7ee9-58c4-46e3-8f31-961dfb488150 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.network.neutron [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] Releasing lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-changed-d1383062-7e89-4ca1-a140-27490e36d621 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing instance network info cache due to event network-changed-d1383062-7e89-4ca1-a140-27490e36d621. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] Acquiring lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] Acquired lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.network.neutron [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing network info cache for port d1383062-7e89-4ca1-a140-27490e36d621 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.network.neutron [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:22:33 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Instance destroyed successfully.
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.objects.instance [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'resources' on Instance uuid eb712362-b6b8-4a19-8f5b-8c374d6c4d87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1081479971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1081479971',id=2,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGjOU9EW2aSTQ6LThOiRDF4utalg+tsviiM8orNc2RM3jBR/IYDksyXS2IStjIBlycILbeNViTcf4xQGQHqvqFePxwxGgPLyqjutal2484sVd/KwplLIrUEg+FkltYxhg==',key_name='tempest-keypair-376302873',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:20:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e1d8e2c039d94beea94f85d8d5a95d95',ramdisk_id='',reservation_id='r-hbv005jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-175335890',owner_user_name='tempest-AttachVolumeShelveTestJSON-175335890-project-member',shelved_at='2023-11-07T15:22:31.700428',shelved_host='user',shelved_image_id='e3625d1e-ba61-4243-a5ea-0e8012f23bdd'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c7596f1e0e748728fa459908f89aede',uuid=eb712362-b6b8-4a19-8f5b-8c374d6c4d87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converting VIF {"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d7fccd97-1db7-4dac-b2e9-6d5b4004aa70,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7fccd97-1d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG os_vif [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d7fccd97-1db7-4dac-b2e9-6d5b4004aa70,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7fccd97-1d') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-3f111ab4-5232-42fd-8929-7830706ebf0b req-c4f3255e-3938-46b3-8050-300e3d93ff61 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received event network-changed-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-3f111ab4-5232-42fd-8929-7830706ebf0b req-c4f3255e-3938-46b3-8050-300e3d93ff61 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Refreshing instance network info cache due to event network-changed-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3f111ab4-5232-42fd-8929-7830706ebf0b req-c4f3255e-3938-46b3-8050-300e3d93ff61 service nova] Acquiring lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3f111ab4-5232-42fd-8929-7830706ebf0b req-c4f3255e-3938-46b3-8050-300e3d93ff61 service nova] Acquired lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.network.neutron [req-3f111ab4-5232-42fd-8929-7830706ebf0b req-c4f3255e-3938-46b3-8050-300e3d93ff61 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Refreshing network info cache for port d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7fccd97-1d, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40d447c0-9d87-431b-85fe-5a21519cd93c) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:33 user nova-compute[75018]: INFO os_vif [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d7fccd97-1db7-4dac-b2e9-6d5b4004aa70,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7fccd97-1d')
Nov 07 15:22:33 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Deleting instance files /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87_del
Nov 07 15:22:33 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Deletion of /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87_del complete
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Successfully updated port: 0961679c-4367-4cb0-b7f8-b763408f97c6 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75018) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 07 15:22:33 user nova-compute[75018]: INFO nova.virt.libvirt.host [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] UEFI support detected
Nov 07 15:22:33 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Deleted allocations for instance eb712362-b6b8-4a19-8f5b-8c374d6c4d87
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.network.neutron [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2ff9dcd1-79b0-4ff8-a257-bb64a55c891f req-7d9637a7-f16c-4b81-aa7e-06616886ca78 service nova] Releasing lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Successfully updated port: af3cc600-3a36-42ec-8976-b1c950150d96 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.objects.instance [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'numa_topology' on Instance uuid eb712362-b6b8-4a19-8f5b-8c374d6c4d87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.objects.base [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Object Instance<eb712362-b6b8-4a19-8f5b-8c374d6c4d87> lazy-loaded attributes: resources,numa_topology {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.network.neutron [req-3f111ab4-5232-42fd-8929-7830706ebf0b req-c4f3255e-3938-46b3-8050-300e3d93ff61 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updated VIF entry in instance network info cache for port d7fccd97-1db7-4dac-b2e9-6d5b4004aa70. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.network.neutron [req-3f111ab4-5232-42fd-8929-7830706ebf0b req-c4f3255e-3938-46b3-8050-300e3d93ff61 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updating instance_info_cache with network_info: [{"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3f111ab4-5232-42fd-8929-7830706ebf0b req-c4f3255e-3938-46b3-8050-300e3d93ff61 service nova] Releasing lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:22:33 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82834e0b-a648-4d60-b001-5bbc05bd8ee3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.704s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-changed-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing instance network info cache due to event network-changed-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] Acquiring lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] Acquired lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.network.neutron [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing network info cache for port e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.network.neutron [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Successfully updated port: da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.network.neutron [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] Releasing lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-changed-af3cc600-3a36-42ec-8976-b1c950150d96 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing instance network info cache due to event network-changed-af3cc600-3a36-42ec-8976-b1c950150d96. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] Acquiring lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] Acquired lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.network.neutron [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing network info cache for port af3cc600-3a36-42ec-8976-b1c950150d96 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.network.neutron [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Successfully updated port: c265f2ff-01fc-4405-81dc-7612ee11764e {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-changed-5a2e7ee9-58c4-46e3-8f31-961dfb488150 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing instance network info cache due to event network-changed-5a2e7ee9-58c4-46e3-8f31-961dfb488150. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] Acquiring lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] Acquired lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.network.neutron [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing network info cache for port 5a2e7ee9-58c4-46e3-8f31-961dfb488150 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.network.neutron [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fae8f202-58d1-43d9-a9cd-a0a82730ee05 req-52fae468-1839-4e2b-83ef-ba134928ca38 service nova] Releasing lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquired lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.network.neutron [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.network.neutron [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] Releasing lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-changed-0961679c-4367-4cb0-b7f8-b763408f97c6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing instance network info cache due to event network-changed-0961679c-4367-4cb0-b7f8-b763408f97c6. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] Acquiring lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] Acquired lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:34 user nova-compute[75018]: DEBUG nova.network.neutron [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing network info cache for port 0961679c-4367-4cb0-b7f8-b763408f97c6 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Successfully updated port: 106cd061-e91b-4718-8c52-cbaf14defe8c {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG nova.network.neutron [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG nova.network.neutron [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] Releasing lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-changed-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing instance network info cache due to event network-changed-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] Acquiring lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] Acquired lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG nova.network.neutron [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing network info cache for port da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG nova.network.neutron [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG nova.network.neutron [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b29ee701-0de2-4aab-a59a-d2a93e3103bf req-d96ab1b7-4d60-4468-827a-706a5749eac0 service nova] Releasing lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquired lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:22:35 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:22:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-1e09bd1d-2477-41a8-b289-451c9fff82fc req-ac1c500c-eea2-40b5-bb4a-5a5f654f0bb2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-changed-c265f2ff-01fc-4405-81dc-7612ee11764e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-1e09bd1d-2477-41a8-b289-451c9fff82fc req-ac1c500c-eea2-40b5-bb4a-5a5f654f0bb2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing instance network info cache due to event network-changed-c265f2ff-01fc-4405-81dc-7612ee11764e. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1e09bd1d-2477-41a8-b289-451c9fff82fc req-ac1c500c-eea2-40b5-bb4a-5a5f654f0bb2 service nova] Acquiring lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:36 user nova-compute[75018]: DEBUG nova.network.neutron [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updating instance_info_cache with network_info: [{"id": "82c43c00-84c9-470a-b788-2372caaad4b2", "address": "fa:16:3e:3f:70:d2", "network": {"id": "9d6ee218-a040-4dc9-b6f5-7f14d78d624e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1764392216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c43c00-84", "ovs_interfaceid": "82c43c00-84c9-470a-b788-2372caaad4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "address": "fa:16:3e:92:e5:10", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ab878f-bc", "ovs_interfaceid": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56f2d51d-5593-464f-b7da-df1c81449a23", "address": "fa:16:3e:c6:3c:c1", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f2d51d-55", "ovs_interfaceid": "56f2d51d-5593-464f-b7da-df1c81449a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "address": "fa:16:3e:c2:ab:57", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d8a867-7f", "ovs_interfaceid": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "address": "fa:16:3e:4b:dd:69", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape606a4ce-7e", "ovs_interfaceid": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af3cc600-3a36-42ec-8976-b1c950150d96", "address": "fa:16:3e:81:53:e5", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cc600-3a", "ovs_interfaceid": "af3cc600-3a36-42ec-8976-b1c950150d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c265f2ff-01fc-4405-81dc-7612ee11764e", "address": "fa:16:3e:6c:fc:63", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc265f2ff-01", "ovs_interfaceid": "c265f2ff-01fc-4405-81dc-7612ee11764e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-changed-106cd061-e91b-4718-8c52-cbaf14defe8c {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing instance network info cache due to event network-changed-106cd061-e91b-4718-8c52-cbaf14defe8c. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] Acquiring lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Releasing lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Instance network_info: |[{"id": "82c43c00-84c9-470a-b788-2372caaad4b2", "address": "fa:16:3e:3f:70:d2", "network": {"id": "9d6ee218-a040-4dc9-b6f5-7f14d78d624e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1764392216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c43c00-84", "ovs_interfaceid": "82c43c00-84c9-470a-b788-2372caaad4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "address": "fa:16:3e:92:e5:10", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ab878f-bc", "ovs_interfaceid": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56f2d51d-5593-464f-b7da-df1c81449a23", "address": "fa:16:3e:c6:3c:c1", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f2d51d-55", "ovs_interfaceid": "56f2d51d-5593-464f-b7da-df1c81449a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "address": "fa:16:3e:c2:ab:57", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d8a867-7f", "ovs_interfaceid": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "address": "fa:16:3e:4b:dd:69", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape606a4ce-7e", "ovs_interfaceid": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af3cc600-3a36-42ec-8976-b1c950150d96", "address": "fa:16:3e:81:53:e5", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cc600-3a", "ovs_interfaceid": "af3cc600-3a36-42ec-8976-b1c950150d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c265f2ff-01fc-4405-81dc-7612ee11764e", "address": "fa:16:3e:6c:fc:63", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc265f2ff-01", "ovs_interfaceid": "c265f2ff-01fc-4405-81dc-7612ee11764e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:22:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1e09bd1d-2477-41a8-b289-451c9fff82fc req-ac1c500c-eea2-40b5-bb4a-5a5f654f0bb2 service nova] Acquired lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:36 user nova-compute[75018]: DEBUG nova.network.neutron [req-1e09bd1d-2477-41a8-b289-451c9fff82fc req-ac1c500c-eea2-40b5-bb4a-5a5f654f0bb2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing network info cache for port c265f2ff-01fc-4405-81dc-7612ee11764e {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-1e09bd1d-2477-41a8-b289-451c9fff82fc req-ac1c500c-eea2-40b5-bb4a-5a5f654f0bb2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updated VIF entry in instance network info cache for port c265f2ff-01fc-4405-81dc-7612ee11764e. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-1e09bd1d-2477-41a8-b289-451c9fff82fc req-ac1c500c-eea2-40b5-bb4a-5a5f654f0bb2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updating instance_info_cache with network_info: [{"id": "82c43c00-84c9-470a-b788-2372caaad4b2", "address": "fa:16:3e:3f:70:d2", "network": {"id": "9d6ee218-a040-4dc9-b6f5-7f14d78d624e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1764392216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c43c00-84", "ovs_interfaceid": "82c43c00-84c9-470a-b788-2372caaad4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "address": "fa:16:3e:92:e5:10", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ab878f-bc", "ovs_interfaceid": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56f2d51d-5593-464f-b7da-df1c81449a23", "address": "fa:16:3e:c6:3c:c1", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f2d51d-55", "ovs_interfaceid": "56f2d51d-5593-464f-b7da-df1c81449a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "address": "fa:16:3e:c2:ab:57", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d8a867-7f", "ovs_interfaceid": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "address": "fa:16:3e:4b:dd:69", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape606a4ce-7e", "ovs_interfaceid": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af3cc600-3a36-42ec-8976-b1c950150d96", "address": "fa:16:3e:81:53:e5", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cc600-3a", "ovs_interfaceid": "af3cc600-3a36-42ec-8976-b1c950150d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c265f2ff-01fc-4405-81dc-7612ee11764e", "address": "fa:16:3e:6c:fc:63", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc265f2ff-01", "ovs_interfaceid": "c265f2ff-01fc-4405-81dc-7612ee11764e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1e09bd1d-2477-41a8-b289-451c9fff82fc req-ac1c500c-eea2-40b5-bb4a-5a5f654f0bb2 service nova] Releasing lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG nova.network.neutron [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [{"id": "73054878-c401-487b-8a75-1a637723b058", "address": "fa:16:3e:e7:75:3b", "network": {"id": "b4f2a6c5-feec-4805-869e-2ede50c3990d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232412547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73054878-c4", "ovs_interfaceid": "73054878-c401-487b-8a75-1a637723b058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0961679c-4367-4cb0-b7f8-b763408f97c6", "address": "fa:16:3e:4f:9a:a7", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0961679c-43", "ovs_interfaceid": "0961679c-4367-4cb0-b7f8-b763408f97c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "address": "fa:16:3e:e6:8a:29", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda084a72-6e", "ovs_interfaceid": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "106cd061-e91b-4718-8c52-cbaf14defe8c", "address": "fa:16:3e:53:d7:da", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106cd061-e9", "ovs_interfaceid": "106cd061-e91b-4718-8c52-cbaf14defe8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Releasing lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Instance network_info: |[{"id": "73054878-c401-487b-8a75-1a637723b058", "address": "fa:16:3e:e7:75:3b", "network": {"id": "b4f2a6c5-feec-4805-869e-2ede50c3990d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232412547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73054878-c4", "ovs_interfaceid": "73054878-c401-487b-8a75-1a637723b058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0961679c-4367-4cb0-b7f8-b763408f97c6", "address": "fa:16:3e:4f:9a:a7", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0961679c-43", "ovs_interfaceid": "0961679c-4367-4cb0-b7f8-b763408f97c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "address": "fa:16:3e:e6:8a:29", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda084a72-6e", "ovs_interfaceid": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "106cd061-e91b-4718-8c52-cbaf14defe8c", "address": "fa:16:3e:53:d7:da", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106cd061-e9", "ovs_interfaceid": "106cd061-e91b-4718-8c52-cbaf14defe8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] Acquired lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing network info cache for port 106cd061-e91b-4718-8c52-cbaf14defe8c {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updated VIF entry in instance network info cache for port 106cd061-e91b-4718-8c52-cbaf14defe8c. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [{"id": "73054878-c401-487b-8a75-1a637723b058", "address": "fa:16:3e:e7:75:3b", "network": {"id": "b4f2a6c5-feec-4805-869e-2ede50c3990d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232412547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73054878-c4", "ovs_interfaceid": "73054878-c401-487b-8a75-1a637723b058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0961679c-4367-4cb0-b7f8-b763408f97c6", "address": "fa:16:3e:4f:9a:a7", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0961679c-43", "ovs_interfaceid": "0961679c-4367-4cb0-b7f8-b763408f97c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "address": "fa:16:3e:e6:8a:29", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda084a72-6e", "ovs_interfaceid": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "106cd061-e91b-4718-8c52-cbaf14defe8c", "address": "fa:16:3e:53:d7:da", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106cd061-e9", "ovs_interfaceid": "106cd061-e91b-4718-8c52-cbaf14defe8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] Releasing lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Received event network-changed-76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Refreshing instance network info cache due to event network-changed-76649643-812d-4246-873b-3209e1d13b85. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] Acquiring lock "refresh_cache-811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] Acquired lock "refresh_cache-811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Refreshing network info cache for port 76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:38 user nova-compute[75018]: DEBUG nova.network.neutron [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Updated VIF entry in instance network info cache for port 76649643-812d-4246-873b-3209e1d13b85. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:22:38 user nova-compute[75018]: DEBUG nova.network.neutron [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Updating instance_info_cache with network_info: [{"id": "76649643-812d-4246-873b-3209e1d13b85", "address": "fa:16:3e:77:19:09", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76649643-81", "ovs_interfaceid": "76649643-812d-4246-873b-3209e1d13b85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e3228bab-afea-4f79-a4bf-3d482a537db4 req-9a128bf6-4368-4b3e-b758-3e6667dc0c77 service nova] Releasing lock "refresh_cache-811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:38 user nova-compute[75018]: DEBUG nova.compute.manager [req-723d57fc-ad63-436a-90e6-cd70f7ed6521 req-7a6f75a0-abe1-48ad-a22b-fd525bd42fb9 service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Received event network-changed-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:38 user nova-compute[75018]: DEBUG nova.compute.manager [req-723d57fc-ad63-436a-90e6-cd70f7ed6521 req-7a6f75a0-abe1-48ad-a22b-fd525bd42fb9 service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Refreshing instance network info cache due to event network-changed-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-723d57fc-ad63-436a-90e6-cd70f7ed6521 req-7a6f75a0-abe1-48ad-a22b-fd525bd42fb9 service nova] Acquiring lock "refresh_cache-569b9815-efc4-46d0-832e-9931fdd7d6ad" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-723d57fc-ad63-436a-90e6-cd70f7ed6521 req-7a6f75a0-abe1-48ad-a22b-fd525bd42fb9 service nova] Acquired lock "refresh_cache-569b9815-efc4-46d0-832e-9931fdd7d6ad" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:38 user nova-compute[75018]: DEBUG nova.network.neutron [req-723d57fc-ad63-436a-90e6-cd70f7ed6521 req-7a6f75a0-abe1-48ad-a22b-fd525bd42fb9 service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Refreshing network info cache for port 4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:39 user nova-compute[75018]: DEBUG nova.network.neutron [req-723d57fc-ad63-436a-90e6-cd70f7ed6521 req-7a6f75a0-abe1-48ad-a22b-fd525bd42fb9 service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Updated VIF entry in instance network info cache for port 4b7ff3f5-f222-4af3-905a-acb2ebef3aa9. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:22:39 user nova-compute[75018]: DEBUG nova.network.neutron [req-723d57fc-ad63-436a-90e6-cd70f7ed6521 req-7a6f75a0-abe1-48ad-a22b-fd525bd42fb9 service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Updating instance_info_cache with network_info: [{"id": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "address": "fa:16:3e:76:54:9c", "network": {"id": "4f26fb82-d023-4342-9035-8726850c06ad", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-819357445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "878175ee02584bcbb6f34320413d5a81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7ff3f5-f2", "ovs_interfaceid": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-723d57fc-ad63-436a-90e6-cd70f7ed6521 req-7a6f75a0-abe1-48ad-a22b-fd525bd42fb9 service nova] Releasing lock "refresh_cache-569b9815-efc4-46d0-832e-9931fdd7d6ad" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXrMIYit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:22:47 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:22:47 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:22:47 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51c6c4d-ab36-42fc-bf68-8b22985bedff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:22:47 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cbbf25-cda1-49ff-be31-c825bf5022f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af] added
Nov 07 15:22:47 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e9f444-62c5-4fcb-8c23-e23539fdcf73]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca346d6-e1a7-415b-9625-10d38c179be5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qXrMIYit {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qXrMIYit" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5eb7ac-92ac-4135-aa8c-ce7ff56c01bb]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qXrMIYit'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa873ecf-3b42-48f5-b5e8-c664c84ccee5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[81441dee-471b-4e23-ba11-f5a3ba6915cb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:22:47 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:22:47 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfe756d-2872-4a34-97fd-a96857698b84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af, portal: 172.16.0.220,3260]
Nov 07 15:22:47 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af, portal: 172.16.0.220,3260] successful.
Nov 07 15:22:47 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4a1494-3393-469a-81d9-ea74cde3f159]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44f5c8e-3562-4747-8d2d-a432e38af0c9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:22:47 user nova-compute[75018]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af (non-flash)
Nov 07 15:22:47 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:22:47 user nova-compute[75018]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af (non-flash)
Nov 07 15:22:47 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[db624ff4-5c1b-4c61-9781-b20c9b37c8de]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:22:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXrMIYit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:22:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-73b53af3-37fe-4309-b7d9-deabebb88b4f req-c04cba3e-cbb4-4226-ac8e-15ccd2494056 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received event network-changed-5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-73b53af3-37fe-4309-b7d9-deabebb88b4f req-c04cba3e-cbb4-4226-ac8e-15ccd2494056 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Refreshing instance network info cache due to event network-changed-5b3da5d6-6cee-4668-b7cd-5d328309eca6. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-73b53af3-37fe-4309-b7d9-deabebb88b4f req-c04cba3e-cbb4-4226-ac8e-15ccd2494056 service nova] Acquiring lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-73b53af3-37fe-4309-b7d9-deabebb88b4f req-c04cba3e-cbb4-4226-ac8e-15ccd2494056 service nova] Acquired lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:48 user nova-compute[75018]: DEBUG nova.network.neutron [req-73b53af3-37fe-4309-b7d9-deabebb88b4f req-c04cba3e-cbb4-4226-ac8e-15ccd2494056 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Refreshing network info cache for port 5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:22:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26233623663323661', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:22:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233623663323661', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:22:48 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lazy-loading 'flavor' on Instance uuid b8d3da3e-3927-4f4e-b9a3-994d45d5a408 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:22:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:22:48 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:22:48 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:22:48 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:22:48 user nova-compute[75018]:   <serial>9eb6ad90-697c-4f72-8942-a03dd21ee8af</serial>
Nov 07 15:22:48 user nova-compute[75018]: </disk>
Nov 07 15:22:48 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:22:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "interface-f9efb536-b47e-4e87-bc54-fdf69cacf8e3-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "interface-f9efb536-b47e-4e87-bc54-fdf69cacf8e3-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:48 user nova-compute[75018]: DEBUG nova.objects.instance [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lazy-loading 'flavor' on Instance uuid f9efb536-b47e-4e87-bc54-fdf69cacf8e3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG nova.network.neutron [req-73b53af3-37fe-4309-b7d9-deabebb88b4f req-c04cba3e-cbb4-4226-ac8e-15ccd2494056 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Updated VIF entry in instance network info cache for port 5b3da5d6-6cee-4668-b7cd-5d328309eca6. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG nova.network.neutron [req-73b53af3-37fe-4309-b7d9-deabebb88b4f req-c04cba3e-cbb4-4226-ac8e-15ccd2494056 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Updating instance_info_cache with network_info: [{"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-73b53af3-37fe-4309-b7d9-deabebb88b4f req-c04cba3e-cbb4-4226-ac8e-15ccd2494056 service nova] Releasing lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG nova.objects.instance [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lazy-loading 'pci_requests' on Instance uuid f9efb536-b47e-4e87-bc54-fdf69cacf8e3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG nova.objects.base [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Object Instance<f9efb536-b47e-4e87-bc54-fdf69cacf8e3> lazy-loaded attributes: flavor,pci_requests {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG nova.policy [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8dd118649a4241bb95956240a2393048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c9868af5b9d4666b842470b30e169d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:22:49 user nova-compute[75018]: INFO nova.virt.block_device [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Booting with volume 29be4268-c29e-452c-a5a0-0edd6a9d3eb3 at /dev/vdb
Nov 07 15:22:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG os_brick.utils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7c6ad1-b3a4-48b6-a898-8fc311ffdb7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] No VIF found with MAC fa:16:3e:e9:c1:25, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea580d9-22ed-4db1-9165-c768d87a0867]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdc0a12-e552-42fd-bcd0-5716d863057a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d3b105-8975-447f-84e0-d285423f7027]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:22:49 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:22:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8ef9cf-ccb9-42e6-b6a4-62f207d91252]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG os_brick.utils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:22:49 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updating existing volume attachment record: 51c97886-1b6c-4fbf-836d-e117b1b32fe8 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:22:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae9fe379-9d60-480a-a66e-10cce4bf3926 tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.842s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:50 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Successfully created port: 59996421-4eca-48d7-a613-1e938d23fc17 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Successfully updated port: 59996421-4eca-48d7-a613-1e938d23fc17 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-db6f3809-3bd4-4a47-98e9-0f2a242e0559 req-e0b0756b-4e31-4843-be9b-92ca7cb752b9 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received event network-changed-59996421-4eca-48d7-a613-1e938d23fc17 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-db6f3809-3bd4-4a47-98e9-0f2a242e0559 req-e0b0756b-4e31-4843-be9b-92ca7cb752b9 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Refreshing instance network info cache due to event network-changed-59996421-4eca-48d7-a613-1e938d23fc17. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-db6f3809-3bd4-4a47-98e9-0f2a242e0559 req-e0b0756b-4e31-4843-be9b-92ca7cb752b9 service nova] Acquiring lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-db6f3809-3bd4-4a47-98e9-0f2a242e0559 req-e0b0756b-4e31-4843-be9b-92ca7cb752b9 service nova] Acquired lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG nova.network.neutron [req-db6f3809-3bd4-4a47-98e9-0f2a242e0559 req-e0b0756b-4e31-4843-be9b-92ca7cb752b9 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Refreshing network info cache for port 59996421-4eca-48d7-a613-1e938d23fc17 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:51 user nova-compute[75018]: INFO nova.compute.manager [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Terminating instance
Nov 07 15:22:51 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:51 user nova-compute[75018]: INFO nova.virt.block_device [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Booting with volume 37beef21-da5e-4cfb-8dae-11c45d37d1d6 at /dev/vdb
Nov 07 15:22:51 user nova-compute[75018]: DEBUG os_brick.utils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e82721-2055-4f15-9296-ec312403cd26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a607cd-8e0b-4472-ab7e-bddbd3268c60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3503fd-1c5b-4319-9dfc-394238272a21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd98aa4-e7d2-4c10-b158-d6db0c979ed2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:22:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:22:52 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[32658e22-e93a-4b81-8739-c56141714d9a]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.utils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating existing volume attachment record: 428b9dd4-6f9e-4aaa-a87b-ece4311071ec {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.network.neutron [req-db6f3809-3bd4-4a47-98e9-0f2a242e0559 req-e0b0756b-4e31-4843-be9b-92ca7cb752b9 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Added VIF to instance network info cache for port 59996421-4eca-48d7-a613-1e938d23fc17. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3488}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.network.neutron [req-db6f3809-3bd4-4a47-98e9-0f2a242e0559 req-e0b0756b-4e31-4843-be9b-92ca7cb752b9 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Updating instance_info_cache with network_info: [{"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59996421-4eca-48d7-a613-1e938d23fc17", "address": "fa:16:3e:b8:5e:1e", "network": {"id": "8b16abf0-67a0-46d6-b688-5059b2dd37e9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1556414992", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59996421-4e", "ovs_interfaceid": "59996421-4eca-48d7-a613-1e938d23fc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-db6f3809-3bd4-4a47-98e9-0f2a242e0559 req-e0b0756b-4e31-4843-be9b-92ca7cb752b9 service nova] Releasing lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquired lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:22:52 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Instance destroyed successfully.
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.objects.instance [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lazy-loading 'resources' on Instance uuid b8d3da3e-3927-4f4e-b9a3-994d45d5a408 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-71303583',display_name='tempest-DeleteServersTestJSON-server-71303583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-71303583',id=3,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:20:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f985bd7fe8d429eaae3646f80b3fecc',ramdisk_id='',reservation_id='r-43249mw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-409494025',owner_user_name='tempest-DeleteServersTestJSON-409494025-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:20:45Z,user_data=None,user_id='961920ba4f4046eaa91025e52897db1e',uuid=b8d3da3e-3927-4f4e-b9a3-994d45d5a408,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07ef7c80-642e-4806-a038-12f69714fa5a", "address": "fa:16:3e:e9:c1:25", "network": {"id": "895875dd-6ac7-4acf-ad8a-c03e8ae599e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226052599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f985bd7fe8d429eaae3646f80b3fecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ef7c80-64", "ovs_interfaceid": "07ef7c80-642e-4806-a038-12f69714fa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Converting VIF {"id": "07ef7c80-642e-4806-a038-12f69714fa5a", "address": "fa:16:3e:e9:c1:25", "network": {"id": "895875dd-6ac7-4acf-ad8a-c03e8ae599e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226052599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f985bd7fe8d429eaae3646f80b3fecc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ef7c80-64", "ovs_interfaceid": "07ef7c80-642e-4806-a038-12f69714fa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c1:25,bridge_name='br-int',has_traffic_filtering=True,id=07ef7c80-642e-4806-a038-12f69714fa5a,network=Network(895875dd-6ac7-4acf-ad8a-c03e8ae599e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ef7c80-64') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_vif [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c1:25,bridge_name='br-int',has_traffic_filtering=True,id=07ef7c80-642e-4806-a038-12f69714fa5a,network=Network(895875dd-6ac7-4acf-ad8a-c03e8ae599e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ef7c80-64') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07ef7c80-64, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:22:52 user nova-compute[75018]: WARNING nova.network.neutron [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] 8b16abf0-67a0-46d6-b688-5059b2dd37e9 already exists in list: networks containing: ['8b16abf0-67a0-46d6-b688-5059b2dd37e9']. ignoring it
Nov 07 15:22:52 user nova-compute[75018]: WARNING nova.network.neutron [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] 59996421-4eca-48d7-a613-1e938d23fc17 already exists in list: port_ids containing: ['59996421-4eca-48d7-a613-1e938d23fc17']. ignoring it
Nov 07 15:22:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78cc2b3d-5225-4af3-b401-2d584d3c8fcb) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:52 user nova-compute[75018]: INFO os_vif [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c1:25,bridge_name='br-int',has_traffic_filtering=True,id=07ef7c80-642e-4806-a038-12f69714fa5a,network=Network(895875dd-6ac7-4acf-ad8a-c03e8ae599e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ef7c80-64')
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qXrMIYit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:22:52 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4bd48f-8ed0-4d28-96dd-f54fc56ff225]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:22:52 user nova-compute[75018]: No targets found.
Nov 07 15:22:52 user nova-compute[75018]: iSNS:
Nov 07 15:22:52 user nova-compute[75018]: No targets found.
Nov 07 15:22:52 user nova-compute[75018]: STATIC:
Nov 07 15:22:52 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af
Nov 07 15:22:52 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:22:52 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:22:52 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582
Nov 07 15:22:52 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:22:52 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:22:52 user nova-compute[75018]: FIRMWARE:
Nov 07 15:22:52 user nova-compute[75018]: No targets found.
Nov 07 15:22:52 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:22:52 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:22:52 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a757f391-941f-4132-8d68-a379931da24a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b4a5ef-05eb-43bb-8a11-4f1a783d8f4d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:22:52 user nova-compute[75018]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af (non-flash)
Nov 07 15:22:52 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:22:52 user nova-compute[75018]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af (non-flash)
Nov 07 15:22:52 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb0033ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af'): ({'sdc'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Removing single pathed devices sdc {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[588d7aa3-ded6-4926-bd28-3751e8cb206b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8733c904-4014-4bed-806f-01a762e6617a]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Flushing IO for device /dev/sdc {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c92a1d-a922-4e9f-a684-f59850746bef]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9414e99a-1b0f-4af2-af45-a8d2299be262]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90fa11a-bc10-4c36-b24c-cebde448c16a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b7176e-064f-4144-a1a7-f14cba795f81]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af, portal: 172.16.0.220,3260]
Nov 07 15:22:52 user nova-compute[75018]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af, portal: 172.16.0.220,3260] successful.
Nov 07 15:22:52 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eb6ad90-697c-4f72-8942-a03dd21ee8af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8d2f89-9462-449b-8949-a74dda885e7c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] <== disconnect_volume: return (353ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:22:52 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Deleting instance files /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408_del
Nov 07 15:22:52 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Deletion of /opt/stack/data/nova/instances/b8d3da3e-3927-4f4e-b9a3-994d45d5a408_del complete
Nov 07 15:22:52 user nova-compute[75018]: INFO nova.compute.manager [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Updating instance_info_cache with network_info: [{"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59996421-4eca-48d7-a613-1e938d23fc17", "address": "fa:16:3e:b8:5e:1e", "network": {"id": "8b16abf0-67a0-46d6-b688-5059b2dd37e9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1556414992", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59996421-4e", "ovs_interfaceid": "59996421-4eca-48d7-a613-1e938d23fc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Releasing lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1580286647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1580286647',id=6,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBa2umF2j3NFcrA/MMVfFX9CwszOvYSV953cPLJB8Fg9xF6mpuVYI1nrRM/8pACoITM+FQT+M6FG3/0v9UsQ2UUg5VLULbr4xVkSLj0F171iDoJzrj+ppTAogqlmzzug==',key_name='tempest-keypair-464082042',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:21:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5c9868af5b9d4666b842470b30e169d2',ramdisk_id='',reservation_id='r-tw13f7f8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2013364869',owner_user_name='tempest-TaggedAttachmentsTest-2013364869-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:21:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd118649a4241bb95956240a2393048',uuid=f9efb536-b47e-4e87-bc54-fdf69cacf8e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59996421-4eca-48d7-a613-1e938d23fc17", "address": "fa:16:3e:b8:5e:1e", "network": {"id": "8b16abf0-67a0-46d6-b688-5059b2dd37e9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1556414992", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59996421-4e", "ovs_interfaceid": "59996421-4eca-48d7-a613-1e938d23fc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Converting VIF {"id": "59996421-4eca-48d7-a613-1e938d23fc17", "address": "fa:16:3e:b8:5e:1e", "network": {"id": "8b16abf0-67a0-46d6-b688-5059b2dd37e9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1556414992", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59996421-4e", "ovs_interfaceid": "59996421-4eca-48d7-a613-1e938d23fc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:1e,bridge_name='br-int',has_traffic_filtering=True,id=59996421-4eca-48d7-a613-1e938d23fc17,network=Network(8b16abf0-67a0-46d6-b688-5059b2dd37e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59996421-4e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG os_vif [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:1e,bridge_name='br-int',has_traffic_filtering=True,id=59996421-4eca-48d7-a613-1e938d23fc17,network=Network(8b16abf0-67a0-46d6-b688-5059b2dd37e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59996421-4e') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3702960f-6fd4-5126-a043-3fd30df41dba', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59996421-4e, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59996421-4e, col_values=(('qos', UUID('27eaa43d-48e0-4f0c-a3be-eaeb6be58df9')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59996421-4e, col_values=(('external_ids', {'iface-id': '59996421-4eca-48d7-a613-1e938d23fc17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:5e:1e', 'vm-uuid': 'f9efb536-b47e-4e87-bc54-fdf69cacf8e3'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:53 user nova-compute[75018]: INFO os_vif [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:1e,bridge_name='br-int',has_traffic_filtering=True,id=59996421-4eca-48d7-a613-1e938d23fc17,network=Network(8b16abf0-67a0-46d6-b688-5059b2dd37e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59996421-4e')
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1580286647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1580286647',id=6,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBa2umF2j3NFcrA/MMVfFX9CwszOvYSV953cPLJB8Fg9xF6mpuVYI1nrRM/8pACoITM+FQT+M6FG3/0v9UsQ2UUg5VLULbr4xVkSLj0F171iDoJzrj+ppTAogqlmzzug==',key_name='tempest-keypair-464082042',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:21:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5c9868af5b9d4666b842470b30e169d2',ramdisk_id='',reservation_id='r-tw13f7f8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2013364869',owner_user_name='tempest-TaggedAttachmentsTest-2013364869-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:21:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd118649a4241bb95956240a2393048',uuid=f9efb536-b47e-4e87-bc54-fdf69cacf8e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59996421-4eca-48d7-a613-1e938d23fc17", "address": "fa:16:3e:b8:5e:1e", "network": {"id": "8b16abf0-67a0-46d6-b688-5059b2dd37e9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1556414992", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59996421-4e", "ovs_interfaceid": "59996421-4eca-48d7-a613-1e938d23fc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Converting VIF {"id": "59996421-4eca-48d7-a613-1e938d23fc17", "address": "fa:16:3e:b8:5e:1e", "network": {"id": "8b16abf0-67a0-46d6-b688-5059b2dd37e9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1556414992", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59996421-4e", "ovs_interfaceid": "59996421-4eca-48d7-a613-1e938d23fc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:1e,bridge_name='br-int',has_traffic_filtering=True,id=59996421-4eca-48d7-a613-1e938d23fc17,network=Network(8b16abf0-67a0-46d6-b688-5059b2dd37e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59996421-4e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] attach device xml: <interface type="ethernet">
Nov 07 15:22:53 user nova-compute[75018]:   <mac address="fa:16:3e:b8:5e:1e"/>
Nov 07 15:22:53 user nova-compute[75018]:   <model type="virtio"/>
Nov 07 15:22:53 user nova-compute[75018]:   <mtu size="1442"/>
Nov 07 15:22:53 user nova-compute[75018]:   <target dev="tap59996421-4e"/>
Nov 07 15:22:53 user nova-compute[75018]: </interface>
Nov 07 15:22:53 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-3b6a1d3f-aafb-4c2a-b902-06250df485cf req-1f016415-004d-4828-b9cb-afb7417055d8 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Received event network-vif-unplugged-07ef7c80-642e-4806-a038-12f69714fa5a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3b6a1d3f-aafb-4c2a-b902-06250df485cf req-1f016415-004d-4828-b9cb-afb7417055d8 service nova] Acquiring lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3b6a1d3f-aafb-4c2a-b902-06250df485cf req-1f016415-004d-4828-b9cb-afb7417055d8 service nova] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3b6a1d3f-aafb-4c2a-b902-06250df485cf req-1f016415-004d-4828-b9cb-afb7417055d8 service nova] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-3b6a1d3f-aafb-4c2a-b902-06250df485cf req-1f016415-004d-4828-b9cb-afb7417055d8 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] No waiting events found dispatching network-vif-unplugged-07ef7c80-642e-4806-a038-12f69714fa5a {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-3b6a1d3f-aafb-4c2a-b902-06250df485cf req-1f016415-004d-4828-b9cb-afb7417055d8 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Received event network-vif-unplugged-07ef7c80-642e-4806-a038-12f69714fa5a for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-3b6a1d3f-aafb-4c2a-b902-06250df485cf req-1f016415-004d-4828-b9cb-afb7417055d8 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Received event network-vif-plugged-07ef7c80-642e-4806-a038-12f69714fa5a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3b6a1d3f-aafb-4c2a-b902-06250df485cf req-1f016415-004d-4828-b9cb-afb7417055d8 service nova] Acquiring lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3b6a1d3f-aafb-4c2a-b902-06250df485cf req-1f016415-004d-4828-b9cb-afb7417055d8 service nova] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3b6a1d3f-aafb-4c2a-b902-06250df485cf req-1f016415-004d-4828-b9cb-afb7417055d8 service nova] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-3b6a1d3f-aafb-4c2a-b902-06250df485cf req-1f016415-004d-4828-b9cb-afb7417055d8 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] No waiting events found dispatching network-vif-plugged-07ef7c80-642e-4806-a038-12f69714fa5a {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:22:53 user nova-compute[75018]: WARNING nova.compute.manager [req-3b6a1d3f-aafb-4c2a-b902-06250df485cf req-1f016415-004d-4828-b9cb-afb7417055d8 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Received unexpected event network-vif-plugged-07ef7c80-642e-4806-a038-12f69714fa5a for instance with vm_state active and task_state deleting.
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-e7150ea4-9efe-4d21-bb17-2ad6f789bff5 req-355702ad-3ac0-4227-a43b-c40d226909ea service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received event network-vif-plugged-59996421-4eca-48d7-a613-1e938d23fc17 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e7150ea4-9efe-4d21-bb17-2ad6f789bff5 req-355702ad-3ac0-4227-a43b-c40d226909ea service nova] Acquiring lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e7150ea4-9efe-4d21-bb17-2ad6f789bff5 req-355702ad-3ac0-4227-a43b-c40d226909ea service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e7150ea4-9efe-4d21-bb17-2ad6f789bff5 req-355702ad-3ac0-4227-a43b-c40d226909ea service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-e7150ea4-9efe-4d21-bb17-2ad6f789bff5 req-355702ad-3ac0-4227-a43b-c40d226909ea service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] No waiting events found dispatching network-vif-plugged-59996421-4eca-48d7-a613-1e938d23fc17 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:22:53 user nova-compute[75018]: WARNING nova.compute.manager [req-e7150ea4-9efe-4d21-bb17-2ad6f789bff5 req-355702ad-3ac0-4227-a43b-c40d226909ea service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received unexpected event network-vif-plugged-59996421-4eca-48d7-a613-1e938d23fc17 for instance with vm_state active and task_state None.
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] No BDM found with device name hda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] No VIF found with MAC fa:16:3e:e1:55:2d, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:22:53 user nova-compute[75018]:   <nova:package version="0.0.0"/>
Nov 07 15:22:53 user nova-compute[75018]:   <nova:name>tempest-device-tagging-server-1580286647</nova:name>
Nov 07 15:22:53 user nova-compute[75018]:   <nova:creationTime>2023-11-07 15:22:53</nova:creationTime>
Nov 07 15:22:53 user nova-compute[75018]:   <nova:flavor name="m1.tiny">
Nov 07 15:22:53 user nova-compute[75018]:     <nova:memory>512</nova:memory>
Nov 07 15:22:53 user nova-compute[75018]:     <nova:disk>1</nova:disk>
Nov 07 15:22:53 user nova-compute[75018]:     <nova:swap>0</nova:swap>
Nov 07 15:22:53 user nova-compute[75018]:     <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:22:53 user nova-compute[75018]:     <nova:vcpus>1</nova:vcpus>
Nov 07 15:22:53 user nova-compute[75018]:   </nova:flavor>
Nov 07 15:22:53 user nova-compute[75018]:   <nova:owner>
Nov 07 15:22:53 user nova-compute[75018]:     <nova:user uuid="8dd118649a4241bb95956240a2393048">tempest-TaggedAttachmentsTest-2013364869-project-member</nova:user>
Nov 07 15:22:53 user nova-compute[75018]:     <nova:project uuid="5c9868af5b9d4666b842470b30e169d2">tempest-TaggedAttachmentsTest-2013364869</nova:project>
Nov 07 15:22:53 user nova-compute[75018]:   </nova:owner>
Nov 07 15:22:53 user nova-compute[75018]:   <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:22:53 user nova-compute[75018]:   <nova:ports>
Nov 07 15:22:53 user nova-compute[75018]:     <nova:port uuid="5b3da5d6-6cee-4668-b7cd-5d328309eca6">
Nov 07 15:22:53 user nova-compute[75018]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 07 15:22:53 user nova-compute[75018]:     </nova:port>
Nov 07 15:22:53 user nova-compute[75018]:     <nova:port uuid="59996421-4eca-48d7-a613-1e938d23fc17">
Nov 07 15:22:53 user nova-compute[75018]:       <nova:ip type="fixed" address="10.10.10.97" ipVersion="4"/>
Nov 07 15:22:53 user nova-compute[75018]:     </nova:port>
Nov 07 15:22:53 user nova-compute[75018]:   </nova:ports>
Nov 07 15:22:53 user nova-compute[75018]: </nova:instance>
Nov 07 15:22:53 user nova-compute[75018]:  {{(pid=75018) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f36ad46-2e7a-4eab-ba45-6d98c9a3e8f2 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "interface-f9efb536-b47e-4e87-bc54-fdf69cacf8e3-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.705s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:53 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Took 1.12 seconds to deallocate network for instance.
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-790db8a8-4e53-41fc-950c-0489edfb2c5f req-da3371f6-69d9-4d5f-804b-6cbda1ef9e98 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Received event network-vif-deleted-07ef7c80-642e-4806-a038-12f69714fa5a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:53 user nova-compute[75018]: INFO nova.compute.manager [req-790db8a8-4e53-41fc-950c-0489edfb2c5f req-da3371f6-69d9-4d5f-804b-6cbda1ef9e98 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Neutron deleted interface 07ef7c80-642e-4806-a038-12f69714fa5a; detaching it from the instance and deleting it from the info cache
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.network.neutron [req-790db8a8-4e53-41fc-950c-0489edfb2c5f req-da3371f6-69d9-4d5f-804b-6cbda1ef9e98 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-790db8a8-4e53-41fc-950c-0489edfb2c5f req-da3371f6-69d9-4d5f-804b-6cbda1ef9e98 service nova] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Detach interface failed, port_id=07ef7c80-642e-4806-a038-12f69714fa5a, reason: Instance b8d3da3e-3927-4f4e-b9a3-994d45d5a408 could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:22:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:54 user nova-compute[75018]: INFO nova.compute.manager [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] [instance: b8d3da3e-3927-4f4e-b9a3-994d45d5a408] Took 0.99 seconds to detach 1 volumes for instance.
Nov 07 15:22:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:54 user nova-compute[75018]: DEBUG nova.objects.instance [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lazy-loading 'flavor' on Instance uuid f9efb536-b47e-4e87-bc54-fdf69cacf8e3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lazy-loading 'flavor' on Instance uuid e3abd70e-baf7-4f13-832c-43696a5ea80c {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:55 user nova-compute[75018]: INFO nova.compute.manager [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Attaching volume e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 to /dev/vdb
Nov 07 15:22:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lazy-loading 'flavor' on Instance uuid 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lazy-loading 'flavor' on Instance uuid 569b9815-efc4-46d0-832e-9931fdd7d6ad {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG os_brick.utils [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c393d5b1-a174-41bc-9d96-0e708dc5fb67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fa3309-1d79-45b9-a955-337af49aff84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a3feb5-7c3a-47b0-9ef6-3af12658e813]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aad182-acd6-442f-8f48-bf64da53070a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:22:55 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb9353a-6d71-4a8e-91ca-00e6fa470cf5]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG os_brick.utils [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Updating existing volume attachment record: 790cd32e-eda9-48d2-8434-20bf2e574f0b {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:55 user nova-compute[75018]: INFO nova.compute.manager [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Attaching volume cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 to /dev/vdb
Nov 07 15:22:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-5025a165-2ea2-459b-9624-0b4279f18eb9 req-b4280584-4aec-408e-8afe-f41916ca393d service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received event network-vif-plugged-59996421-4eca-48d7-a613-1e938d23fc17 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5025a165-2ea2-459b-9624-0b4279f18eb9 req-b4280584-4aec-408e-8afe-f41916ca393d service nova] Acquiring lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5025a165-2ea2-459b-9624-0b4279f18eb9 req-b4280584-4aec-408e-8afe-f41916ca393d service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5025a165-2ea2-459b-9624-0b4279f18eb9 req-b4280584-4aec-408e-8afe-f41916ca393d service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-5025a165-2ea2-459b-9624-0b4279f18eb9 req-b4280584-4aec-408e-8afe-f41916ca393d service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] No waiting events found dispatching network-vif-plugged-59996421-4eca-48d7-a613-1e938d23fc17 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:22:55 user nova-compute[75018]: WARNING nova.compute.manager [req-5025a165-2ea2-459b-9624-0b4279f18eb9 req-b4280584-4aec-408e-8afe-f41916ca393d service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received unexpected event network-vif-plugged-59996421-4eca-48d7-a613-1e938d23fc17 for instance with vm_state active and task_state None.
Nov 07 15:22:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-5025a165-2ea2-459b-9624-0b4279f18eb9 req-b4280584-4aec-408e-8afe-f41916ca393d service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Received event network-changed-cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-5025a165-2ea2-459b-9624-0b4279f18eb9 req-b4280584-4aec-408e-8afe-f41916ca393d service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Refreshing instance network info cache due to event network-changed-cd50d84f-cf19-4b67-a73a-12005d5f5078. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5025a165-2ea2-459b-9624-0b4279f18eb9 req-b4280584-4aec-408e-8afe-f41916ca393d service nova] Acquiring lock "refresh_cache-e3abd70e-baf7-4f13-832c-43696a5ea80c" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5025a165-2ea2-459b-9624-0b4279f18eb9 req-b4280584-4aec-408e-8afe-f41916ca393d service nova] Acquired lock "refresh_cache-e3abd70e-baf7-4f13-832c-43696a5ea80c" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG nova.network.neutron [req-5025a165-2ea2-459b-9624-0b4279f18eb9 req-b4280584-4aec-408e-8afe-f41916ca393d service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Refreshing network info cache for port cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:22:55 user nova-compute[75018]: INFO nova.compute.manager [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Attaching volume fad71d3b-1467-4189-bb87-db6051b3bc20 to /dev/vdb
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.807s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:55 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Deleted allocations for instance b8d3da3e-3927-4f4e-b9a3-994d45d5a408
Nov 07 15:22:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e25cc35e-d2a0-40a0-9430-a30458f76a1f tempest-DeleteServersTestJSON-409494025 tempest-DeleteServersTestJSON-409494025-project-member] Lock "b8d3da3e-3927-4f4e-b9a3-994d45d5a408" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.518s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:22:56 user nova-compute[75018]: DEBUG nova.network.neutron [req-5025a165-2ea2-459b-9624-0b4279f18eb9 req-b4280584-4aec-408e-8afe-f41916ca393d service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Updated VIF entry in instance network info cache for port cd50d84f-cf19-4b67-a73a-12005d5f5078. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:22:56 user nova-compute[75018]: DEBUG nova.network.neutron [req-5025a165-2ea2-459b-9624-0b4279f18eb9 req-b4280584-4aec-408e-8afe-f41916ca393d service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Updating instance_info_cache with network_info: [{"id": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "address": "fa:16:3e:0f:01:77", "network": {"id": "e5c35126-c724-438d-ac83-88c7304a8c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-84841748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beb79fc8bbc746178042b24a9019665c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd50d84f-cf", "ovs_interfaceid": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:22:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5025a165-2ea2-459b-9624-0b4279f18eb9 req-b4280584-4aec-408e-8afe-f41916ca393d service nova] Releasing lock "refresh_cache-e3abd70e-baf7-4f13-832c-43696a5ea80c" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:22:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:22:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-0bd4d5c1-f3ff-48af-83d6-20064657bad4 req-3581129b-6a01-4c06-85c8-479566dd5f09 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Received event network-changed-9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:23:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-0bd4d5c1-f3ff-48af-83d6-20064657bad4 req-3581129b-6a01-4c06-85c8-479566dd5f09 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Refreshing instance network info cache due to event network-changed-9fcc5742-dd8b-4205-be25-c16830b915a4. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:23:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0bd4d5c1-f3ff-48af-83d6-20064657bad4 req-3581129b-6a01-4c06-85c8-479566dd5f09 service nova] Acquiring lock "refresh_cache-d5341681-9ba6-4f21-a67c-00d50aea8762" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:23:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0bd4d5c1-f3ff-48af-83d6-20064657bad4 req-3581129b-6a01-4c06-85c8-479566dd5f09 service nova] Acquired lock "refresh_cache-d5341681-9ba6-4f21-a67c-00d50aea8762" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:23:13 user nova-compute[75018]: DEBUG nova.network.neutron [req-0bd4d5c1-f3ff-48af-83d6-20064657bad4 req-3581129b-6a01-4c06-85c8-479566dd5f09 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Refreshing network info cache for port 9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:23:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:23:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:23:13 user nova-compute[75018]: INFO nova.compute.manager [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Attaching volume 6ef90d02-43f0-4323-900b-d570ffdebb3f to /dev/sdc
Nov 07 15:23:14 user nova-compute[75018]: DEBUG nova.network.neutron [req-0bd4d5c1-f3ff-48af-83d6-20064657bad4 req-3581129b-6a01-4c06-85c8-479566dd5f09 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Updated VIF entry in instance network info cache for port 9fcc5742-dd8b-4205-be25-c16830b915a4. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG nova.network.neutron [req-0bd4d5c1-f3ff-48af-83d6-20064657bad4 req-3581129b-6a01-4c06-85c8-479566dd5f09 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Updating instance_info_cache with network_info: [{"id": "9fcc5742-dd8b-4205-be25-c16830b915a4", "address": "fa:16:3e:5c:7f:f5", "network": {"id": "05954183-75be-4860-8cc3-fcb57270fc76", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1012347870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9378a0a596064f23a0e85400f26a7710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fcc5742-dd", "ovs_interfaceid": "9fcc5742-dd8b-4205-be25-c16830b915a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0bd4d5c1-f3ff-48af-83d6-20064657bad4 req-3581129b-6a01-4c06-85c8-479566dd5f09 service nova] Releasing lock "refresh_cache-d5341681-9ba6-4f21-a67c-00d50aea8762" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.utils [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a982898-5780-4012-a289-40ec068a1f6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58d8796-d7bb-4587-a8bf-7e62ad10b105]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[13895ff2-b2b2-4bc6-800c-48e7ec8af5f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8aa0dd-21d0-49d7-b92d-f3957c5c1d5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:23:14 user nova-compute[75018]: INFO nova.virt.block_device [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Booting with volume ba300fbd-97e8-4e36-a021-caac03c8f2c1 at /dev/vdc
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:23:14 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b45e8d-757b-43b1-9af3-a8c5b9d64abb]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.utils [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Updating existing volume attachment record: fd9c8868-9719-4693-9eac-aeea21f4980a {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.utils [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d932d1b4-2b36-4766-891b-9cad6f668d8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc89c5f5-891d-4247-85bb-85d6ad8cd8df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Acquiring lock "d5341681-9ba6-4f21-a67c-00d50aea8762" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33d4ee3-32f2-4e30-be2d-ba492827f1a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[286e9d87-219d-4cac-be41-40f4f50619ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG nova.objects.instance [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lazy-loading 'flavor' on Instance uuid d5341681-9ba6-4f21-a67c-00d50aea8762 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.utils [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:23:14 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d086728-5e0e-4086-9a7f-1cf51a49146c]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.utils [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Updating existing volume attachment record: f6606b7a-4972-44ba-b6b2-da0d90513070 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa3bbd7-af1d-4e57-8068-bd446e0caa93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e92116d-6add-485e-b455-458dd04a48d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.144s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c290516-4101-4f5a-bea4-be57e8a91f8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c2a013-4b3e-479a-a524-5ff54299a149]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:23:14 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:23:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da3e544-5e62-4543-aab5-a933f091afc0]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG os_brick.utils [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:23:14 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Updating existing volume attachment record: c4f0452b-9554-4a89-b40f-3351686e15db {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG os_brick.utils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e37734-567d-43ba-a545-03fbeef3ef96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e913e1-4e61-459e-afb1-365dc37ea578]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f1ecca-c2f5-47bc-8c7a-1d5a8f85728a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c0a6f4-e8d4-416b-9af8-c9d3c27c7101]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:23:15 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:23:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b2f1c5-c024-4eb1-9f6f-3fb148d00b0b]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG os_brick.utils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:23:15 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updating existing volume attachment record: 23964ea6-8689-4f70-b454-4e2aae974748 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:23:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:23:17 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKUwLZeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:23:18 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:23:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:23:18 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:23:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:23:18 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:23:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[791af38e-ea6c-440d-a803-32e850db576e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:23:18 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa864dc8-36c8-428b-85cb-ec5f384a1464]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45] added
Nov 07 15:23:18 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c71941-3395-4805-83c2-fbb74ca0a59e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ca863c-0059-4548-8abd-bbf8cebdda7e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKUwLZeE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKUwLZeE" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdece6a1-c857-4e8c-bd14-37667d1165ae]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tKUwLZeE'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8defee6-8663-4672-9652-e36c47ef3825]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9135439c-a905-4179-85fb-1a71af360071]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Updating instance_info_cache with network_info: [{"id": "76649643-812d-4246-873b-3209e1d13b85", "address": "fa:16:3e:77:19:09", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76649643-81", "ovs_interfaceid": "76649643-812d-4246-873b-3209e1d13b85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e36678b-eef5-4a93-84ff-1d06a2b93852]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45, portal: 172.16.0.220,3260]
Nov 07 15:23:19 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45, portal: 172.16.0.220,3260] successful.
Nov 07 15:23:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee32067e-cdbe-4f04-b0b6-b0f6772147ca]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[650b58a5-0697-49bd-a81a-cae4f9947a34]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:19 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:19 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e907d021-fb12-4b72-9361-ce7226993fbe]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKUwLZeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23262643565636562', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262643565636562', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG nova.objects.instance [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lazy-loading 'flavor' on Instance uuid f9efb536-b47e-4e87-bc54-fdf69cacf8e3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:23:20 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:23:20 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:23:20 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:23:20 user nova-compute[75018]:   <serial>e8f72a29-56f8-4f29-a0fe-a4e7845f5d45</serial>
Nov 07 15:23:20 user nova-compute[75018]: </disk>
Nov 07 15:23:20 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] No BDM found with device name hda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] No VIF found with MAC fa:16:3e:e1:55:2d, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:23:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:22 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:23:22 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:23:22 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7529MB free_disk=25.391441345214844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:23:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:23:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8257c590-204a-4fde-8487-79b8c0c87ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 569b9815-efc4-46d0-832e-9931fdd7d6ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e3abd70e-baf7-4f13-832c-43696a5ea80c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 22422ecc-1027-41c5-9bea-066fdc8ca995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance d5341681-9ba6-4f21-a67c-00d50aea8762 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 5212605c-c913-483f-874b-17af335aeb2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 934e9b7f-8bb4-4487-83cd-c5fbc92daefc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 44f8bf0d-9714-45cf-8f71-206a8bb75a3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:23:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:23:24 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:23:24 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:23:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-20a8a5ca-4c8f-4887-a2f5-906b6c934077 req-55f97252-644f-4034-a7dd-1d43913acd7b service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Received event network-changed-57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:23:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-20a8a5ca-4c8f-4887-a2f5-906b6c934077 req-55f97252-644f-4034-a7dd-1d43913acd7b service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Refreshing instance network info cache due to event network-changed-57d57fc6-3705-4b40-9d00-44c182114a8a. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:23:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-20a8a5ca-4c8f-4887-a2f5-906b6c934077 req-55f97252-644f-4034-a7dd-1d43913acd7b service nova] Acquiring lock "refresh_cache-5212605c-c913-483f-874b-17af335aeb2f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:23:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-20a8a5ca-4c8f-4887-a2f5-906b6c934077 req-55f97252-644f-4034-a7dd-1d43913acd7b service nova] Acquired lock "refresh_cache-5212605c-c913-483f-874b-17af335aeb2f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:23:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-20a8a5ca-4c8f-4887-a2f5-906b6c934077 req-55f97252-644f-4034-a7dd-1d43913acd7b service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Refreshing network info cache for port 57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:23:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-20a8a5ca-4c8f-4887-a2f5-906b6c934077 req-55f97252-644f-4034-a7dd-1d43913acd7b service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Updated VIF entry in instance network info cache for port 57d57fc6-3705-4b40-9d00-44c182114a8a. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:23:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-20a8a5ca-4c8f-4887-a2f5-906b6c934077 req-55f97252-644f-4034-a7dd-1d43913acd7b service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Updating instance_info_cache with network_info: [{"id": "57d57fc6-3705-4b40-9d00-44c182114a8a", "address": "fa:16:3e:90:c3:82", "network": {"id": "10ccf061-c522-4a5b-ba65-4d89ef2fb661", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-853530484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abdb560dcda4650a47cc53ae59c9783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d57fc6-37", "ovs_interfaceid": "57d57fc6-3705-4b40-9d00-44c182114a8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:23:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-20a8a5ca-4c8f-4887-a2f5-906b6c934077 req-55f97252-644f-4034-a7dd-1d43913acd7b service nova] Releasing lock "refresh_cache-5212605c-c913-483f-874b-17af335aeb2f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:23:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:23:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:23:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:23:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:23:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:23:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YkmSGHeq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:23:39 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:23:39 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:23:39 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e92d08-1b5d-4127-849b-19e141560ddc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:23:39 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bdcb19-0c9f-446f-a8da-da78896bc147]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20] added
Nov 07 15:23:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b74835-e38a-4b09-a8f8-bc6d6f524c98]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[003acdce-9f20-4085-bed1-6558d6b877df]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YkmSGHeq {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YkmSGHeq" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4237ee-34a7-410d-95ee-68e1281e95d0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YkmSGHeq'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[418981d4-58b6-4ab5-8ba8-6291cac5a626]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9a18cb-8c12-45c1-aa4f-9619be8dfe01]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:39 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:39 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b51428-2fdc-496b-947a-b5ce14354da6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20, portal: 172.16.0.220,3260]
Nov 07 15:23:39 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20, portal: 172.16.0.220,3260] successful.
Nov 07 15:23:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a210da3-c0f6-4d48-8ba2-b7eff749fbc6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee81dce6-af78-4f82-aa2e-5372855e1904]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:39 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:39 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:23:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:39 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:39 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:23:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a41b9b8-e509-4193-83f9-562cd84f2bdc]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:23:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YkmSGHeq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:23:39 user nova-compute[75018]: INFO nova.virt.block_device [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Booting with volume d102cc69-aac9-407f-b1f3-5b9d70fa7b5a at /dev/vdc
Nov 07 15:23:40 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:23:40 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26538383438646366', 'path': '/dev/sdd'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:23:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538383438646366', 'path': '/dev/sdd'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:23:40 user nova-compute[75018]: DEBUG nova.objects.instance [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lazy-loading 'flavor' on Instance uuid 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:23:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:23:40 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:23:40 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:23:40 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:23:40 user nova-compute[75018]:   <serial>fad71d3b-1467-4189-bb87-db6051b3bc20</serial>
Nov 07 15:23:40 user nova-compute[75018]: </disk>
Nov 07 15:23:40 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:23:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:23:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:23:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] No VIF found with MAC fa:16:3e:77:19:09, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFeCpyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:23:42 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:23:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:23:42 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:23:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:23:42 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[be681859-1d79-4481-93d5-9c9f6398891b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:23:42 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a32930-9490-4c0e-a7e0-a5708034a4fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f] added
Nov 07 15:23:42 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ced1ee-ae53-4358-a747-d51fd817b247]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6319bfe-0519-4144-9dd6-cc4a11279234]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbFeCpyB {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbFeCpyB" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8498df35-e547-46af-bad6-0c03ff13ac2e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UbFeCpyB'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Acquiring lock "d5341681-9ba6-4f21-a67c-00d50aea8762" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:23:42 user nova-compute[75018]: INFO nova.compute.manager [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Attaching volume 14ee9fe1-1cb0-4307-a92f-81baa76d5e6c to /dev/vdb
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8c5f09-dd8f-4b03-b925-1fca51d1e2a8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-024fc8bd-6a50-4077-a794-276550f1b0a5 tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.562s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4739d540-a9ab-4f5e-bbad-5ff35c3201be]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:42 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:42 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:23:42 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:42 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:42 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:23:42 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:23:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgmzSRQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:23:43 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c06d711-5170-45e5-a9b2-3b8e51a94067]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f, portal: 172.16.0.220,3260]
Nov 07 15:23:43 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f, portal: 172.16.0.220,3260] successful.
Nov 07 15:23:43 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c11a02a-e2bc-4a3b-a098-aec88e99d72e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c6a63f-75a5-4e0e-9d36-945244b8b715]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:43 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:43 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:23:43 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:23:43 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:43 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:43 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:23:43 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:23:43 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcc73b0-dc9b-4b72-bddf-93ec9b75d8f6]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFeCpyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f097b81-fb5a-4b1b-aa1a-a5baf5baf611 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.519s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.utils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[128f62a5-5a20-4df4-8464-c7d0691ddbd9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68eb7cb-9347-4fee-9888-4d18273896b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fd6407-8a6c-48fb-941a-26c6b9ae3b4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4478f8-cbc7-43b7-b8be-cdd496c6f061]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:23:43 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd942c2-0160-436d-b361-017737d910d2]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.utils [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.utils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating existing volume attachment record: 60f6c397-648a-41bf-8a3d-62d799dd60a7 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aebe153-68ea-4c47-a605-8da36d6d3e0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[868ba2bf-ba62-4f41-b7c3-7660a8eb1676]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bc571e-8a6b-42eb-bbc6-cb81677679c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8869a39-f8af-47da-92ec-a9ebd47d9489]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:23:43 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:23:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[825fc23a-a7f0-4f0f-a4ec-922a9bf1b9e0]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG os_brick.utils [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:23:43 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Updating existing volume attachment record: f148d5bb-1657-484a-b17f-6743e8a6b47b {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26634653535346339', 'path': '/dev/sde'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634653535346339', 'path': '/dev/sde'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.149s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:23:44 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:23:44 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:44 user nova-compute[75018]: INFO nova.compute.manager [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Rebuilding instance
Nov 07 15:23:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lazy-loading 'flavor' on Instance uuid 569b9815-efc4-46d0-832e-9931fdd7d6ad {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95c9caf-2012-4102-bd8c-48d606b2b00b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:23:44 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45fc836-bfe9-44a8-a302-90e479053a66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4] added
Nov 07 15:23:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2f739e-be96-4e99-845b-8894e1a0297f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:23:44 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:23:44 user nova-compute[75018]:   <source dev="/dev/sde"/>
Nov 07 15:23:44 user nova-compute[75018]:   <target dev="sdc" bus="scsi"/>
Nov 07 15:23:44 user nova-compute[75018]:   <serial>6ef90d02-43f0-4323-900b-d570ffdebb3f</serial>
Nov 07 15:23:44 user nova-compute[75018]:   <address type="drive" controller="0" unit="2"/>
Nov 07 15:23:44 user nova-compute[75018]: </disk>
Nov 07 15:23:44 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9c0fa6-a7e4-437e-81a9-2f541bd0806b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sgmzSRQy {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG nova.compute.manager [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sgmzSRQy" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc92403-7a7c-4aaa-bcd6-7e8ed3fb4f60]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sgmzSRQy'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71b9941-e64d-4491-b57e-685e762718f2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[678c2575-5293-427e-9254-45ea6fc0a361]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:44 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:44 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:23:44 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:23:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:44 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:44 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:23:44 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:23:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aad0b75-d098-4312-aa56-bc3782df6595]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4, portal: 172.16.0.220,3260]
Nov 07 15:23:44 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4, portal: 172.16.0.220,3260] successful.
Nov 07 15:23:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e024d4-44c0-4a70-bfa0-6dd2efc5ffc6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99cce5b-510e-4ea3-bc60-403fc2b31523]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:44 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:44 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:23:44 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:23:44 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:23:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:44 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:44 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:23:44 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:23:44 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:23:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0f30ba-3a9a-4f04-99dd-da241f4bd5f0]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-372738a4-93d5-47e3-8126-c0c830175ab4 req-aaf9a3e7-2555-4f68-a0ef-d079e1edeed6 service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Received event network-vif-unplugged-57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-372738a4-93d5-47e3-8126-c0c830175ab4 req-aaf9a3e7-2555-4f68-a0ef-d079e1edeed6 service nova] Acquiring lock "5212605c-c913-483f-874b-17af335aeb2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-372738a4-93d5-47e3-8126-c0c830175ab4 req-aaf9a3e7-2555-4f68-a0ef-d079e1edeed6 service nova] Lock "5212605c-c913-483f-874b-17af335aeb2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-372738a4-93d5-47e3-8126-c0c830175ab4 req-aaf9a3e7-2555-4f68-a0ef-d079e1edeed6 service nova] Lock "5212605c-c913-483f-874b-17af335aeb2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-372738a4-93d5-47e3-8126-c0c830175ab4 req-aaf9a3e7-2555-4f68-a0ef-d079e1edeed6 service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] No waiting events found dispatching network-vif-unplugged-57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:23:44 user nova-compute[75018]: WARNING nova.compute.manager [req-372738a4-93d5-47e3-8126-c0c830175ab4 req-aaf9a3e7-2555-4f68-a0ef-d079e1edeed6 service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Received unexpected event network-vif-unplugged-57d57fc6-3705-4b40-9d00-44c182114a8a for instance with vm_state active and task_state rebuilding.
Nov 07 15:23:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] No BDM found with device name sda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:23:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] No VIF found with MAC fa:16:3e:76:54:9c, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:23:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Instance destroyed successfully.
Nov 07 15:23:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Instance destroyed successfully.
Nov 07 15:23:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-994735681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-655130991',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPv8aFD5LWaVVjpuImyl8D4RlPV5xNYVN7NKvQFHB8zaOHQSYdricv6FD20zXu/XqDM3rUoyy7wL0y3axEvbla/s7QURGC98f2Y4d2r6/lV5ouvT8UGE1tcxwINR8RXzg==',key_name='tempest-keypair-2093191890',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5abdb560dcda4650a47cc53ae59c9783',ramdisk_id='',reservation_id='r-acj23alz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1927257890',owner_user_name='tempest-ServerActionsV293TestJSON-1927257890-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa101c0dd31f4796803bf3b600e5b439',uuid=5212605c-c913-483f-874b-17af335aeb2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57d57fc6-3705-4b40-9d00-44c182114a8a", "address": "fa:16:3e:90:c3:82", "network": {"id": "10ccf061-c522-4a5b-ba65-4d89ef2fb661", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-853530484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abdb560dcda4650a47cc53ae59c9783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d57fc6-37", "ovs_interfaceid": "57d57fc6-3705-4b40-9d00-44c182114a8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Converting VIF {"id": "57d57fc6-3705-4b40-9d00-44c182114a8a", "address": "fa:16:3e:90:c3:82", "network": {"id": "10ccf061-c522-4a5b-ba65-4d89ef2fb661", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-853530484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abdb560dcda4650a47cc53ae59c9783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d57fc6-37", "ovs_interfaceid": "57d57fc6-3705-4b40-9d00-44c182114a8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:c3:82,bridge_name='br-int',has_traffic_filtering=True,id=57d57fc6-3705-4b40-9d00-44c182114a8a,network=Network(10ccf061-c522-4a5b-ba65-4d89ef2fb661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d57fc6-37') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_vif [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:c3:82,bridge_name='br-int',has_traffic_filtering=True,id=57d57fc6-3705-4b40-9d00-44c182114a8a,network=Network(10ccf061-c522-4a5b-ba65-4d89ef2fb661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d57fc6-37') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57d57fc6-37, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee079849-ffa0-4818-a8ff-3e04ab57e2bb) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:45 user nova-compute[75018]: INFO os_vif [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:c3:82,bridge_name='br-int',has_traffic_filtering=True,id=57d57fc6-3705-4b40-9d00-44c182114a8a,network=Network(10ccf061-c522-4a5b-ba65-4d89ef2fb661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d57fc6-37')
Nov 07 15:23:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWNgZhKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:23:45 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgmzSRQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] <== connect_volume: return (2570ms) {'type': 'block', 'scsi_wwn': '26534636430336634', 'path': '/dev/sdf'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534636430336634', 'path': '/dev/sdf'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.394s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lazy-loading 'flavor' on Instance uuid e3abd70e-baf7-4f13-832c-43696a5ea80c {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[23daed63-243d-4fd7-b329-93a91c420abc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:23:45 user nova-compute[75018]: No targets found.
Nov 07 15:23:45 user nova-compute[75018]: iSNS:
Nov 07 15:23:45 user nova-compute[75018]: No targets found.
Nov 07 15:23:45 user nova-compute[75018]: STATIC:
Nov 07 15:23:45 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20
Nov 07 15:23:45 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:23:45 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:23:45 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45
Nov 07 15:23:45 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:23:45 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:23:45 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:23:45 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:23:45 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:23:45 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f
Nov 07 15:23:45 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:23:45 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:23:45 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582
Nov 07 15:23:45 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:23:45 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:23:45 user nova-compute[75018]: FIRMWARE:
Nov 07 15:23:45 user nova-compute[75018]: No targets found.
Nov 07 15:23:45 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:23:45 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:23:45 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:23:45 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:23:45 user nova-compute[75018]:   <source dev="/dev/sdf"/>
Nov 07 15:23:45 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:23:45 user nova-compute[75018]:   <serial>cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4</serial>
Nov 07 15:23:45 user nova-compute[75018]: </disk>
Nov 07 15:23:45 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e585bdcc-2ab8-4a26-9cd8-0d3700362773]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[64592be8-1cb7-462e-b2a7-fceb95cec570]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:45 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:45 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:23:45 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:23:45 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:23:45 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:23:45 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:23:45 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:23:45 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:23:45 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:23:45 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb00381360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e44af9-eed7-4ef2-9e39-bb5396862273]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[815f0655-6c99-4bf7-a673-14d51b2b3bcd]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[37de86f3-7504-4dc2-a3f8-7e046ff1c35a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[561b0efd-d411-4e00-bbbe-adff375fb6bd]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[350366ff-096a-4500-888d-0f81eb318183]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d6e2ff-7e8b-4c2c-8671-eb9de43b3339]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582, portal: 172.16.0.220,3260]
Nov 07 15:23:45 user nova-compute[75018]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582, portal: 172.16.0.220,3260] successful.
Nov 07 15:23:45 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1182d08b-5616-4723-9d0f-3536a6a107aa]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] <== disconnect_volume: return (741ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:23:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:23:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Deleting instance files /opt/stack/data/nova/instances/5212605c-c913-483f-874b-17af335aeb2f_del
Nov 07 15:23:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Deletion of /opt/stack/data/nova/instances/5212605c-c913-483f-874b-17af335aeb2f_del complete
Nov 07 15:23:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:23:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:23:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] No VIF found with MAC fa:16:3e:0f:01:77, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:23:46 user nova-compute[75018]: DEBUG nova.compute.manager [req-59e8e034-2fc2-4bfe-8179-89158e55e24f req-854c477e-2e3c-4b69-8f7f-9815333f488e service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Received event network-vif-plugged-57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:23:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-59e8e034-2fc2-4bfe-8179-89158e55e24f req-854c477e-2e3c-4b69-8f7f-9815333f488e service nova] Acquiring lock "5212605c-c913-483f-874b-17af335aeb2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:23:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-59e8e034-2fc2-4bfe-8179-89158e55e24f req-854c477e-2e3c-4b69-8f7f-9815333f488e service nova] Lock "5212605c-c913-483f-874b-17af335aeb2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:23:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-59e8e034-2fc2-4bfe-8179-89158e55e24f req-854c477e-2e3c-4b69-8f7f-9815333f488e service nova] Lock "5212605c-c913-483f-874b-17af335aeb2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:23:46 user nova-compute[75018]: DEBUG nova.compute.manager [req-59e8e034-2fc2-4bfe-8179-89158e55e24f req-854c477e-2e3c-4b69-8f7f-9815333f488e service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] No waiting events found dispatching network-vif-plugged-57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:23:46 user nova-compute[75018]: WARNING nova.compute.manager [req-59e8e034-2fc2-4bfe-8179-89158e55e24f req-854c477e-2e3c-4b69-8f7f-9815333f488e service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Received unexpected event network-vif-plugged-57d57fc6-3705-4b40-9d00-44c182114a8a for instance with vm_state active and task_state rebuilding.
Nov 07 15:23:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:23:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dededd5c-450c-4878-8a1a-c018f8c38a1b tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 52.055s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c6f2893c-4bbc-42f5-a24c-30e0b85397d1 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 70.456s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:24:06 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Creating image(s)
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Did not create local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Ensure instance console log exists: /opt/stack/data/nova/instances/934e9b7f-8bb4-4487-83cd-c5fbc92daefc/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Start _get_guest_xml network_info=[{"id": "82c43c00-84c9-470a-b788-2372caaad4b2", "address": "fa:16:3e:3f:70:d2", "network": {"id": "9d6ee218-a040-4dc9-b6f5-7f14d78d624e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1764392216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c43c00-84", "ovs_interfaceid": "82c43c00-84c9-470a-b788-2372caaad4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "address": "fa:16:3e:92:e5:10", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ab878f-bc", "ovs_interfaceid": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56f2d51d-5593-464f-b7da-df1c81449a23", "address": "fa:16:3e:c6:3c:c1", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f2d51d-55", "ovs_interfaceid": "56f2d51d-5593-464f-b7da-df1c81449a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "address": "fa:16:3e:c2:ab:57", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d8a867-7f", "ovs_interfaceid": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "address": "fa:16:3e:4b:dd:69", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape606a4ce-7e", "ovs_interfaceid": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af3cc600-3a36-42ec-8976-b1c950150d96", "address": "fa:16:3e:81:53:e5", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cc600-3a", "ovs_interfaceid": "af3cc600-3a36-42ec-8976-b1c950150d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c265f2ff-01fc-4405-81dc-7612ee11764e", "address": "fa:16:3e:6c:fc:63", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc265f2ff-01", "ovs_interfaceid": "c265f2ff-01fc-4405-81dc-7612ee11764e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMGdXsrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '934e9b7f-8bb4-4487-83cd-c5fbc92daefc', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9e83453-bfee-4260-986f-6df2d7963867', 'serial': 'e9e83453-bfee-4260-986f-6df2d7963867'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '1bc47b9d-c590-40a8-b9a2-125457bd981a', 'volume_type': None}, {'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlcspWVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '934e9b7f-8bb4-4487-83cd-c5fbc92daefc', 'attached_at': '', 'detached_at': '', 'volume_id': '29be4268-c29e-452c-a5a0-0edd6a9d3eb3', 'serial': '29be4268-c29e-452c-a5a0-0edd6a9d3eb3'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '51c97886-1b6c-4fbf-836d-e117b1b32fe8', 'volume_type': None}, {'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKBbcVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '934e9b7f-8bb4-4487-83cd-c5fbc92daefc', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba300fbd-97e8-4e36-a021-caac03c8f2c1', 'serial': 'ba300fbd-97e8-4e36-a021-caac03c8f2c1'}, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '23964ea6-8689-4f70-b454-4e2aae974748', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:24:06 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:24:06 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMGdXsrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:06 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:06 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:06 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[029aa8f6-0f4d-4afa-8888-575dec0b85e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:24:06 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd74a49f-b377-4fe7-8500-d7823a923a9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867] added
Nov 07 15:24:06 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a2e2b1-d757-4726-9465-acaebeb6904c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0988e6d0-f76d-4e16-93e6-7bf91dca3efe]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMGdXsrO {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMGdXsrO" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3477831f-fce3-44dc-8512-ab23344feee6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMGdXsrO'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cb736a-fa72-4468-a270-66f426449d46]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e6c8a6-527d-4c67-996f-b32d8aa948ad]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:06 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:06 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:06 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:06 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:06 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:06 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:06 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:06 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:06 user nova-compute[75018]: INFO nova.compute.manager [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Detaching volume e8f72a29-56f8-4f29-a0fe-a4e7845f5d45
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5c0156-5078-48ce-8d96-893fcf6830f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867, portal: 172.16.0.220,3260]
Nov 07 15:24:06 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867, portal: 172.16.0.220,3260] successful.
Nov 07 15:24:06 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d173db88-95d1-4da9-b786-f064af60d730]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a82f8f7-3479-468f-a9bd-05750b8a00c9]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:06 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:06 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:06 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:06 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:06 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:06 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:06 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:06 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:06 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:06 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b51918-a7e6-4d9e-9458-97e6e2c034c3]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMGdXsrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:24:06 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 5212605c-c913-483f-874b-17af335aeb2f could not be found.
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWNgZhKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:06 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 07 15:24:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:06 user nova-compute[75018]: INFO nova.virt.block_device [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Attempting to driver detach volume e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 from mountpoint /dev/vdb
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Attempting to detach device vdb from instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:24:06 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:06 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:24:06 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:24:06 user nova-compute[75018]:   <serial>e8f72a29-56f8-4f29-a0fe-a4e7845f5d45</serial>
Nov 07 15:24:06 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 07 15:24:06 user nova-compute[75018]: </disk>
Nov 07 15:24:06 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:24:06 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Successfully detached device vdb from instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 from the persistent domain config.
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:24:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:24:06 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:06 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:24:06 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:24:06 user nova-compute[75018]:   <serial>e8f72a29-56f8-4f29-a0fe-a4e7845f5d45</serial>
Nov 07 15:24:06 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 07 15:24:06 user nova-compute[75018]: </disk>
Nov 07 15:24:06 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:07 user nova-compute[75018]: INFO nova.compute.manager [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Detaching volume fad71d3b-1467-4189-bb87-db6051b3bc20
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23961303036666331', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961303036666331', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.979s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlcspWVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:07 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfd5ca2-d701-48cf-8c65-d07f3cef624e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:24:07 user nova-compute[75018]: No targets found.
Nov 07 15:24:07 user nova-compute[75018]: iSNS:
Nov 07 15:24:07 user nova-compute[75018]: No targets found.
Nov 07 15:24:07 user nova-compute[75018]: STATIC:
Nov 07 15:24:07 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20
Nov 07 15:24:07 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:07 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:07 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867
Nov 07 15:24:07 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:07 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:07 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45
Nov 07 15:24:07 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:07 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:07 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:24:07 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:07 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:07 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f
Nov 07 15:24:07 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:07 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:07 user nova-compute[75018]: FIRMWARE:
Nov 07 15:24:07 user nova-compute[75018]: No targets found.
Nov 07 15:24:07 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:24:07 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:24:07 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[25607b88-cbda-4332-89a6-c5e98f8e9e81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf73148c-f651-4cf2-9bff-97b462ff5f5e]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb001fa290>, {}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Disconnecting from: [] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.096s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] <== disconnect_volume: return (1075ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.068s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:07 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:07 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d1b043-8db3-4867-bfb2-f9792ff0da95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:24:07 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5313254-efaa-4728-a9bd-82b7edaa796a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3] added
Nov 07 15:24:07 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:07 user nova-compute[75018]: INFO nova.virt.block_device [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Attempting to driver detach volume fad71d3b-1467-4189-bb87-db6051b3bc20 from mountpoint /dev/vdb
Nov 07 15:24:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Attempting to detach device vdb from instance 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:24:07 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:07 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:24:07 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:24:07 user nova-compute[75018]:   <serial>fad71d3b-1467-4189-bb87-db6051b3bc20</serial>
Nov 07 15:24:07 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:24:07 user nova-compute[75018]: </disk>
Nov 07 15:24:07 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0868127-e52c-400c-bc46-7a0e724cdb65]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:07 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Successfully detached device vdb from instance 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b from the persistent domain config.
Nov 07 15:24:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:24:07 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:07 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:24:07 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:24:07 user nova-compute[75018]:   <serial>fad71d3b-1467-4189-bb87-db6051b3bc20</serial>
Nov 07 15:24:07 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:24:07 user nova-compute[75018]: </disk>
Nov 07 15:24:07 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9070dd-6705-45e3-b657-28014607396c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MlcspWVm {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MlcspWVm" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3ec5a9-cc7c-46b4-8bad-9fd093fe69d8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MlcspWVm'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f8e87-23eb-4031-9eeb-51c69c338f38]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c14394-ec6a-4cf5-af45-cd868569b28b]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:07 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba81e1e-1c09-461c-9cdf-716efe0535b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3, portal: 172.16.0.220,3260]
Nov 07 15:24:08 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3, portal: 172.16.0.220,3260] successful.
Nov 07 15:24:08 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5f01fc-c0f9-498e-8aab-3497451fca64]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61ca868-36cb-4a51-baec-facd475c6d2f]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:08 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:08 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:08 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:08 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:08 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:08 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:08 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:08 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:08 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:08 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:08 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:08 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d3996e-c1d7-46b5-9b8a-b99abef49384]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlcspWVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:24:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '23366343835346164', 'path': '/dev/sdg'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366343835346164', 'path': '/dev/sdg'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKBbcVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:09 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:09 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:09 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f73bfe-0cdc-4adb-b5d9-6d5f57359292]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:24:09 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8d5c48-b05e-467c-a116-6aa51b59782a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1] added
Nov 07 15:24:09 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a66e881-542c-408b-aea3-fc8694bfabba]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a614829-4187-4f70-86de-65d3b370715e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKBbcVTD {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKBbcVTD" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc569fd-ee2a-4503-838a-1edb52d34b1f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKBbcVTD'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.088s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b8d4e1-1fe3-4f2e-8912-c745f7fde1b0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13f984b-a886-4993-9992-4343963cc2f6]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17dc37b-2cbb-485b-a520-8ce2eb417b5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1, portal: 172.16.0.220,3260]
Nov 07 15:24:09 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1, portal: 172.16.0.220,3260] successful.
Nov 07 15:24:09 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6566335-0a4f-4d00-8ebf-3417f2226032]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbb888f-10bd-4221-b9d9-f617e0d6c5f4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:09 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0a30a7-3e18-45a9-8480-f75c6389ef31]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKBbcVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:09 user nova-compute[75018]: INFO nova.compute.manager [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Detaching volume 6ef90d02-43f0-4323-900b-d570ffdebb3f
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUXPOQKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:10 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:24:10 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Creating image(s)
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Did not create local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Ensure instance console log exists: /opt/stack/data/nova/instances/44f8bf0d-9714-45cf-8f71-206a8bb75a3a/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Start _get_guest_xml network_info=[{"id": "73054878-c401-487b-8a75-1a637723b058", "address": "fa:16:3e:e7:75:3b", "network": {"id": "b4f2a6c5-feec-4805-869e-2ede50c3990d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232412547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73054878-c4", "ovs_interfaceid": "73054878-c401-487b-8a75-1a637723b058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0961679c-4367-4cb0-b7f8-b763408f97c6", "address": "fa:16:3e:4f:9a:a7", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0961679c-43", "ovs_interfaceid": "0961679c-4367-4cb0-b7f8-b763408f97c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "address": "fa:16:3e:e6:8a:29", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda084a72-6e", "ovs_interfaceid": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "106cd061-e91b-4718-8c52-cbaf14defe8c", "address": "fa:16:3e:53:d7:da", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106cd061-e9", "ovs_interfaceid": "106cd061-e91b-4718-8c52-cbaf14defe8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORALivPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '44f8bf0d-9714-45cf-8f71-206a8bb75a3a', 'attached_at': '', 'detached_at': '', 'volume_id': '52a3ccb9-d419-4301-b804-fb5c6a8e4042', 'serial': '52a3ccb9-d419-4301-b804-fb5c6a8e4042'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'e8f04df6-2f15-4ba2-9b8e-2468516ad6c9', 'volume_type': None}, {'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjBQJsLA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '44f8bf0d-9714-45cf-8f71-206a8bb75a3a', 'attached_at': '', 'detached_at': '', 'volume_id': '37beef21-da5e-4cfb-8dae-11c45d37d1d6', 'serial': '37beef21-da5e-4cfb-8dae-11c45d37d1d6'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '428b9dd4-6f9e-4aaa-a87b-ece4311071ec', 'volume_type': None}, {'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQeokpqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '44f8bf0d-9714-45cf-8f71-206a8bb75a3a', 'attached_at': '', 'detached_at': '', 'volume_id': 'd102cc69-aac9-407f-b1f3-5b9d70fa7b5a', 'serial': 'd102cc69-aac9-407f-b1f3-5b9d70fa7b5a'}, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '60f6c397-648a-41bf-8a3d-62d799dd60a7', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:24:10 user nova-compute[75018]: INFO nova.virt.block_device [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Attempting to driver detach volume 6ef90d02-43f0-4323-900b-d570ffdebb3f from mountpoint /dev/sdc
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] Acquiring lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:10 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:24:10 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.utils [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORALivPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:10 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Attempting to detach device sdc from instance 569b9815-efc4-46d0-832e-9931fdd7d6ad from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:24:10 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:10 user nova-compute[75018]:   <source dev="/dev/sde"/>
Nov 07 15:24:10 user nova-compute[75018]:   <target dev="sdc" bus="scsi"/>
Nov 07 15:24:10 user nova-compute[75018]:   <serial>6ef90d02-43f0-4323-900b-d570ffdebb3f</serial>
Nov 07 15:24:10 user nova-compute[75018]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 07 15:24:10 user nova-compute[75018]: </disk>
Nov 07 15:24:10 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[28933a32-b7a3-4f2f-a33c-6e03d7e4c17f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '23133386338333664', 'path': '/dev/sdh'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133386338333664', 'path': '/dev/sdh'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.345s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:10 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:10 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:10 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Successfully detached device sdc from instance 569b9815-efc4-46d0-832e-9931fdd7d6ad from the persistent domain config.
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 569b9815-efc4-46d0-832e-9931fdd7d6ad from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:24:10 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:10 user nova-compute[75018]:   <source dev="/dev/sde"/>
Nov 07 15:24:10 user nova-compute[75018]:   <target dev="sdc" bus="scsi"/>
Nov 07 15:24:10 user nova-compute[75018]:   <serial>6ef90d02-43f0-4323-900b-d570ffdebb3f</serial>
Nov 07 15:24:10 user nova-compute[75018]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 07 15:24:10 user nova-compute[75018]: </disk>
Nov 07 15:24:10 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[719e0038-47ee-4a9d-bfcb-4e3a03f7675c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82c43c00-84c9-470a-b788-2372caaad4b2", "address": "fa:16:3e:3f:70:d2", "network": {"id": "9d6ee218-a040-4dc9-b6f5-7f14d78d624e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1764392216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c43c00-84", "ovs_interfaceid": "82c43c00-84c9-470a-b788-2372caaad4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "82c43c00-84c9-470a-b788-2372caaad4b2", "address": "fa:16:3e:3f:70:d2", "network": {"id": "9d6ee218-a040-4dc9-b6f5-7f14d78d624e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1764392216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c43c00-84", "ovs_interfaceid": "82c43c00-84c9-470a-b788-2372caaad4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:70:d2,bridge_name='br-int',has_traffic_filtering=True,id=82c43c00-84c9-470a-b788-2372caaad4b2,network=Network(9d6ee218-a040-4dc9-b6f5-7f14d78d624e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c43c00-84') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "address": "fa:16:3e:92:e5:10", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ab878f-bc", "ovs_interfaceid": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "address": "fa:16:3e:92:e5:10", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ab878f-bc", "ovs_interfaceid": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e5:10,bridge_name='br-int',has_traffic_filtering=True,id=17ab878f-bcba-42bf-a4ed-15517fa5e244,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17ab878f-bc') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56f2d51d-5593-464f-b7da-df1c81449a23", "address": "fa:16:3e:c6:3c:c1", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f2d51d-55", "ovs_interfaceid": "56f2d51d-5593-464f-b7da-df1c81449a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "56f2d51d-5593-464f-b7da-df1c81449a23", "address": "fa:16:3e:c6:3c:c1", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f2d51d-55", "ovs_interfaceid": "56f2d51d-5593-464f-b7da-df1c81449a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:3c:c1,bridge_name='br-int',has_traffic_filtering=True,id=56f2d51d-5593-464f-b7da-df1c81449a23,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56f2d51d-55') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "address": "fa:16:3e:c2:ab:57", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d8a867-7f", "ovs_interfaceid": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "address": "fa:16:3e:c2:ab:57", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d8a867-7f", "ovs_interfaceid": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ab:57,bridge_name='br-int',has_traffic_filtering=True,id=f7d8a867-7f2c-4f73-8521-b2ec3f646045,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d8a867-7f') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "address": "fa:16:3e:4b:dd:69", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape606a4ce-7e", "ovs_interfaceid": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "address": "fa:16:3e:4b:dd:69", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape606a4ce-7e", "ovs_interfaceid": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:dd:69,bridge_name='br-int',has_traffic_filtering=True,id=e606a4ce-7ebe-46db-8e2b-71dc2ee247a1,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape606a4ce-7e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af3cc600-3a36-42ec-8976-b1c950150d96", "address": "fa:16:3e:81:53:e5", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cc600-3a", "ovs_interfaceid": "af3cc600-3a36-42ec-8976-b1c950150d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "af3cc600-3a36-42ec-8976-b1c950150d96", "address": "fa:16:3e:81:53:e5", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cc600-3a", "ovs_interfaceid": "af3cc600-3a36-42ec-8976-b1c950150d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:53:e5,bridge_name='br-int',has_traffic_filtering=True,id=af3cc600-3a36-42ec-8976-b1c950150d96,network=Network(52802d24-4900-4a5b-a787-9d62114be5fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3cc600-3a') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c265f2ff-01fc-4405-81dc-7612ee11764e", "address": "fa:16:3e:6c:fc:63", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc265f2ff-01", "ovs_interfaceid": "c265f2ff-01fc-4405-81dc-7612ee11764e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "c265f2ff-01fc-4405-81dc-7612ee11764e", "address": "fa:16:3e:6c:fc:63", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc265f2ff-01", "ovs_interfaceid": "c265f2ff-01fc-4405-81dc-7612ee11764e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fc:63,bridge_name='br-int',has_traffic_filtering=True,id=c265f2ff-01fc-4405-81dc-7612ee11764e,network=Network(52802d24-4900-4a5b-a787-9d62114be5fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc265f2ff-01') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.objects.instance [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lazy-loading 'pci_devices' on Instance uuid 934e9b7f-8bb4-4487-83cd-c5fbc92daefc {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bb51b4-2e1a-46c8-83a2-c7ab10de43bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[058189f3-1e8e-42ec-88c4-cb768428aa1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:24:10 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e083ed3a-f58f-4baf-9ab2-7619f2e4575c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1789f887-0369-4c36-95fe-3b2e294246fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:24:10 user nova-compute[75018]:   <uuid>934e9b7f-8bb4-4487-83cd-c5fbc92daefc</uuid>
Nov 07 15:24:10 user nova-compute[75018]:   <name>instance-0000000b</name>
Nov 07 15:24:10 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:24:10 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:24:10 user nova-compute[75018]:   <metadata>
Nov 07 15:24:10 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:24:10 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:24:10 user nova-compute[75018]:       <nova:name>tempest-device-tagging-server-411871331</nova:name>
Nov 07 15:24:10 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:24:06</nova:creationTime>
Nov 07 15:24:10 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:24:10 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:24:10 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:24:10 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:24:10 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:24:10 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:24:10 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:24:10 user nova-compute[75018]:       <nova:owner>
Nov 07 15:24:10 user nova-compute[75018]:         <nova:user uuid="5b3cbd57eebe4bba85843cc4608ec75e">tempest-TaggedBootDevicesTest_v242-1150033045-project-member</nova:user>
Nov 07 15:24:10 user nova-compute[75018]:         <nova:project uuid="fe38e9e3e1d24bb3b3b8b910b1de52ee">tempest-TaggedBootDevicesTest_v242-1150033045</nova:project>
Nov 07 15:24:10 user nova-compute[75018]:       </nova:owner>
Nov 07 15:24:10 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:24:10 user nova-compute[75018]:       <nova:ports>
Nov 07 15:24:10 user nova-compute[75018]:         <nova:port uuid="82c43c00-84c9-470a-b788-2372caaad4b2">
Nov 07 15:24:10 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 07 15:24:10 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:10 user nova-compute[75018]:         <nova:port uuid="17ab878f-bcba-42bf-a4ed-15517fa5e244">
Nov 07 15:24:10 user nova-compute[75018]:           <nova:ip type="fixed" address="10.1.1.178" ipVersion="4"/>
Nov 07 15:24:10 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:10 user nova-compute[75018]:         <nova:port uuid="56f2d51d-5593-464f-b7da-df1c81449a23">
Nov 07 15:24:10 user nova-compute[75018]:           <nova:ip type="fixed" address="10.1.1.21" ipVersion="4"/>
Nov 07 15:24:10 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:10 user nova-compute[75018]:         <nova:port uuid="f7d8a867-7f2c-4f73-8521-b2ec3f646045">
Nov 07 15:24:10 user nova-compute[75018]:           <nova:ip type="fixed" address="10.1.1.30" ipVersion="4"/>
Nov 07 15:24:10 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:10 user nova-compute[75018]:         <nova:port uuid="e606a4ce-7ebe-46db-8e2b-71dc2ee247a1">
Nov 07 15:24:10 user nova-compute[75018]:           <nova:ip type="fixed" address="10.1.1.85" ipVersion="4"/>
Nov 07 15:24:10 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:10 user nova-compute[75018]:         <nova:port uuid="af3cc600-3a36-42ec-8976-b1c950150d96">
Nov 07 15:24:10 user nova-compute[75018]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 07 15:24:10 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:10 user nova-compute[75018]:         <nova:port uuid="c265f2ff-01fc-4405-81dc-7612ee11764e">
Nov 07 15:24:10 user nova-compute[75018]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 07 15:24:10 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:10 user nova-compute[75018]:       </nova:ports>
Nov 07 15:24:10 user nova-compute[75018]:     </nova:instance>
Nov 07 15:24:10 user nova-compute[75018]:   </metadata>
Nov 07 15:24:10 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:24:10 user nova-compute[75018]:     <system>
Nov 07 15:24:10 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:24:10 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:24:10 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:24:10 user nova-compute[75018]:       <entry name="serial">934e9b7f-8bb4-4487-83cd-c5fbc92daefc</entry>
Nov 07 15:24:10 user nova-compute[75018]:       <entry name="uuid">934e9b7f-8bb4-4487-83cd-c5fbc92daefc</entry>
Nov 07 15:24:10 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:24:10 user nova-compute[75018]:     </system>
Nov 07 15:24:10 user nova-compute[75018]:   </sysinfo>
Nov 07 15:24:10 user nova-compute[75018]:   <os>
Nov 07 15:24:10 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:24:10 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:24:10 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:24:10 user nova-compute[75018]:   </os>
Nov 07 15:24:10 user nova-compute[75018]:   <features>
Nov 07 15:24:10 user nova-compute[75018]:     <acpi/>
Nov 07 15:24:10 user nova-compute[75018]:     <apic/>
Nov 07 15:24:10 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:24:10 user nova-compute[75018]:   </features>
Nov 07 15:24:10 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:24:10 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:24:10 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:24:10 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:24:10 user nova-compute[75018]:   </clock>
Nov 07 15:24:10 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:24:10 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:24:10 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:24:10 user nova-compute[75018]:   </cpu>
Nov 07 15:24:10 user nova-compute[75018]:   <devices>
Nov 07 15:24:10 user nova-compute[75018]:     <disk type="file" device="cdrom">
Nov 07 15:24:10 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none"/>
Nov 07 15:24:10 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/934e9b7f-8bb4-4487-83cd-c5fbc92daefc/disk.config"/>
Nov 07 15:24:10 user nova-compute[75018]:       <target dev="hda" bus="ide"/>
Nov 07 15:24:10 user nova-compute[75018]:     </disk>
Nov 07 15:24:10 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:24:10 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:10 user nova-compute[75018]:       <source dev="/dev/sdb"/>
Nov 07 15:24:10 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:24:10 user nova-compute[75018]:       <serial>e9e83453-bfee-4260-986f-6df2d7963867</serial>
Nov 07 15:24:10 user nova-compute[75018]:     </disk>
Nov 07 15:24:10 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:24:10 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:10 user nova-compute[75018]:       <source dev="/dev/sdg"/>
Nov 07 15:24:10 user nova-compute[75018]:       <target dev="vdb" bus="virtio"/>
Nov 07 15:24:10 user nova-compute[75018]:       <serial>29be4268-c29e-452c-a5a0-0edd6a9d3eb3</serial>
Nov 07 15:24:10 user nova-compute[75018]:     </disk>
Nov 07 15:24:10 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:24:10 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:10 user nova-compute[75018]:       <source dev="/dev/sdh"/>
Nov 07 15:24:10 user nova-compute[75018]:       <target dev="vdc" bus="virtio"/>
Nov 07 15:24:10 user nova-compute[75018]:       <serial>ba300fbd-97e8-4e36-a021-caac03c8f2c1</serial>
Nov 07 15:24:10 user nova-compute[75018]:     </disk>
Nov 07 15:24:10 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:10 user nova-compute[75018]:       <mac address="fa:16:3e:3f:70:d2"/>
Nov 07 15:24:10 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:10 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:10 user nova-compute[75018]:       <target dev="tap82c43c00-84"/>
Nov 07 15:24:10 user nova-compute[75018]:     </interface>
Nov 07 15:24:10 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:10 user nova-compute[75018]:       <mac address="fa:16:3e:92:e5:10"/>
Nov 07 15:24:10 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:10 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:10 user nova-compute[75018]:       <target dev="tap17ab878f-bc"/>
Nov 07 15:24:10 user nova-compute[75018]:     </interface>
Nov 07 15:24:10 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:10 user nova-compute[75018]:       <mac address="fa:16:3e:c6:3c:c1"/>
Nov 07 15:24:10 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:10 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:10 user nova-compute[75018]:       <target dev="tap56f2d51d-55"/>
Nov 07 15:24:10 user nova-compute[75018]:     </interface>
Nov 07 15:24:10 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:10 user nova-compute[75018]:       <mac address="fa:16:3e:c2:ab:57"/>
Nov 07 15:24:10 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:10 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:10 user nova-compute[75018]:       <target dev="tapf7d8a867-7f"/>
Nov 07 15:24:10 user nova-compute[75018]:     </interface>
Nov 07 15:24:10 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:10 user nova-compute[75018]:       <mac address="fa:16:3e:4b:dd:69"/>
Nov 07 15:24:10 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:10 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:10 user nova-compute[75018]:       <target dev="tape606a4ce-7e"/>
Nov 07 15:24:10 user nova-compute[75018]:     </interface>
Nov 07 15:24:10 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:10 user nova-compute[75018]:       <mac address="fa:16:3e:81:53:e5"/>
Nov 07 15:24:10 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:10 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:10 user nova-compute[75018]:       <target dev="tapaf3cc600-3a"/>
Nov 07 15:24:10 user nova-compute[75018]:     </interface>
Nov 07 15:24:10 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:10 user nova-compute[75018]:       <mac address="fa:16:3e:6c:fc:63"/>
Nov 07 15:24:10 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:10 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:10 user nova-compute[75018]:       <target dev="tapc265f2ff-01"/>
Nov 07 15:24:10 user nova-compute[75018]:     </interface>
Nov 07 15:24:10 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:24:10 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/934e9b7f-8bb4-4487-83cd-c5fbc92daefc/console.log" append="off"/>
Nov 07 15:24:10 user nova-compute[75018]:     </serial>
Nov 07 15:24:10 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:24:10 user nova-compute[75018]:     <video>
Nov 07 15:24:10 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:10 user nova-compute[75018]:     </video>
Nov 07 15:24:10 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:24:10 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:24:10 user nova-compute[75018]:     </rng>
Nov 07 15:24:10 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:24:10 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:24:10 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:24:10 user nova-compute[75018]:     </memballoon>
Nov 07 15:24:10 user nova-compute[75018]:   </devices>
Nov 07 15:24:10 user nova-compute[75018]: </domain>
Nov 07 15:24:10 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82c43c00-84c9-470a-b788-2372caaad4b2", "address": "fa:16:3e:3f:70:d2", "network": {"id": "9d6ee218-a040-4dc9-b6f5-7f14d78d624e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1764392216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c43c00-84", "ovs_interfaceid": "82c43c00-84c9-470a-b788-2372caaad4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "82c43c00-84c9-470a-b788-2372caaad4b2", "address": "fa:16:3e:3f:70:d2", "network": {"id": "9d6ee218-a040-4dc9-b6f5-7f14d78d624e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1764392216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c43c00-84", "ovs_interfaceid": "82c43c00-84c9-470a-b788-2372caaad4b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:70:d2,bridge_name='br-int',has_traffic_filtering=True,id=82c43c00-84c9-470a-b788-2372caaad4b2,network=Network(9d6ee218-a040-4dc9-b6f5-7f14d78d624e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c43c00-84') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:70:d2,bridge_name='br-int',has_traffic_filtering=True,id=82c43c00-84c9-470a-b788-2372caaad4b2,network=Network(9d6ee218-a040-4dc9-b6f5-7f14d78d624e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c43c00-84') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c] added
Nov 07 15:24:10 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:24:10 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8fbe01-b9b8-497c-9e97-e7b879534576]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afcfe011-0de5-5171-b670-14a92280f69d', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.utils [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82c43c00-84, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82c43c00-84, col_values=(('qos', UUID('f7347d46-9a0b-4c4c-85f4-466b2cf4fe3d')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82c43c00-84, col_values=(('external_ids', {'iface-id': '82c43c00-84c9-470a-b788-2372caaad4b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:70:d2', 'vm-uuid': '934e9b7f-8bb4-4487-83cd-c5fbc92daefc'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d25440-1f5a-4c42-870e-c4e79bd30574]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: INFO os_vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:70:d2,bridge_name='br-int',has_traffic_filtering=True,id=82c43c00-84c9-470a-b788-2372caaad4b2,network=Network(9d6ee218-a040-4dc9-b6f5-7f14d78d624e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c43c00-84')
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "address": "fa:16:3e:92:e5:10", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ab878f-bc", "ovs_interfaceid": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "address": "fa:16:3e:92:e5:10", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ab878f-bc", "ovs_interfaceid": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e5:10,bridge_name='br-int',has_traffic_filtering=True,id=17ab878f-bcba-42bf-a4ed-15517fa5e244,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17ab878f-bc') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e5:10,bridge_name='br-int',has_traffic_filtering=True,id=17ab878f-bcba-42bf-a4ed-15517fa5e244,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17ab878f-bc') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1930456-f275-5e21-a95e-41686a9fe689', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[65de8083-a05e-4d02-8964-bb407947159d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xUXPOQKC {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17ab878f-bc, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17ab878f-bc, col_values=(('qos', UUID('77e5432e-6a23-48c0-8ec4-cab9dfa84e56')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17ab878f-bc, col_values=(('external_ids', {'iface-id': '17ab878f-bcba-42bf-a4ed-15517fa5e244', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:e5:10', 'vm-uuid': '934e9b7f-8bb4-4487-83cd-c5fbc92daefc'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xUXPOQKC" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c461c91f-5e6e-4034-bb4c-32d8836157aa]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xUXPOQKC'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: INFO os_vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e5:10,bridge_name='br-int',has_traffic_filtering=True,id=17ab878f-bcba-42bf-a4ed-15517fa5e244,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17ab878f-bc')
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56f2d51d-5593-464f-b7da-df1c81449a23", "address": "fa:16:3e:c6:3c:c1", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f2d51d-55", "ovs_interfaceid": "56f2d51d-5593-464f-b7da-df1c81449a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "56f2d51d-5593-464f-b7da-df1c81449a23", "address": "fa:16:3e:c6:3c:c1", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f2d51d-55", "ovs_interfaceid": "56f2d51d-5593-464f-b7da-df1c81449a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:3c:c1,bridge_name='br-int',has_traffic_filtering=True,id=56f2d51d-5593-464f-b7da-df1c81449a23,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56f2d51d-55') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:3c:c1,bridge_name='br-int',has_traffic_filtering=True,id=56f2d51d-5593-464f-b7da-df1c81449a23,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56f2d51d-55') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b977422-6e1c-4a93-b3f2-61dcb6f7f13b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '266b715e-775b-5450-879b-5a51735811e2', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c554b8aa-1f1f-4c3a-9897-86b3442daa46]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:10 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:10 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:10 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:10 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:10 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:10 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:10 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:10 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:10 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:10 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:10 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:10 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:10 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:10 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56f2d51d-55, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56f2d51d-55, col_values=(('qos', UUID('eee48146-8a3f-4591-a45b-773e9e44f392')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56f2d51d-55, col_values=(('external_ids', {'iface-id': '56f2d51d-5593-464f-b7da-df1c81449a23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:3c:c1', 'vm-uuid': '934e9b7f-8bb4-4487-83cd-c5fbc92daefc'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:10 user nova-compute[75018]: INFO nova.compute.manager [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Swapping volume cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 for 37393f6f-9fd8-4d07-bc77-16c3a1c5f1d0
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: INFO os_vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:3c:c1,bridge_name='br-int',has_traffic_filtering=True,id=56f2d51d-5593-464f-b7da-df1c81449a23,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56f2d51d-55')
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "address": "fa:16:3e:c2:ab:57", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d8a867-7f", "ovs_interfaceid": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "address": "fa:16:3e:c2:ab:57", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d8a867-7f", "ovs_interfaceid": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ab:57,bridge_name='br-int',has_traffic_filtering=True,id=f7d8a867-7f2c-4f73-8521-b2ec3f646045,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d8a867-7f') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG os_vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ab:57,bridge_name='br-int',has_traffic_filtering=True,id=f7d8a867-7f2c-4f73-8521-b2ec3f646045,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d8a867-7f') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5949430a-e628-5586-b89b-cff55b53426a', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b11e8f-8cc4-43c0-9091-6a5a95129f2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c, portal: 172.16.0.220,3260]
Nov 07 15:24:11 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c, portal: 172.16.0.220,3260] successful.
Nov 07 15:24:11 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7d8a867-7f, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7d8a867-7f, col_values=(('qos', UUID('049a27e1-22b8-45e3-9deb-95a79de9228a')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7d8a867-7f, col_values=(('external_ids', {'iface-id': 'f7d8a867-7f2c-4f73-8521-b2ec3f646045', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:ab:57', 'vm-uuid': '934e9b7f-8bb4-4487-83cd-c5fbc92daefc'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4354ae5-c93a-411f-837c-2a82a4a57a33]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 569b9815-efc4-46d0-832e-9931fdd7d6ad {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: INFO os_vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ab:57,bridge_name='br-int',has_traffic_filtering=True,id=f7d8a867-7f2c-4f73-8521-b2ec3f646045,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d8a867-7f')
Nov 07 15:24:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "address": "fa:16:3e:4b:dd:69", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape606a4ce-7e", "ovs_interfaceid": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "address": "fa:16:3e:4b:dd:69", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape606a4ce-7e", "ovs_interfaceid": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:dd:69,bridge_name='br-int',has_traffic_filtering=True,id=e606a4ce-7ebe-46db-8e2b-71dc2ee247a1,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape606a4ce-7e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG os_vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:dd:69,bridge_name='br-int',has_traffic_filtering=True,id=e606a4ce-7ebe-46db-8e2b-71dc2ee247a1,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape606a4ce-7e') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[757cf4d5-7fba-4947-b1ee-346763a83baf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:11 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:11 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:11 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:11 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:11 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:11 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:11 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:11 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:11 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:11 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:11 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:11 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:11 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:11 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:11 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:11 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.422s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd76d37e0-e238-5c32-afa1-f8d2476a175c', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9602f7-0c06-4c93-8121-4d1fdcbe54aa]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUXPOQKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape606a4ce-7e, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape606a4ce-7e, col_values=(('qos', UUID('df180dbe-eaf1-40ac-a094-77eef33d1a84')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape606a4ce-7e, col_values=(('external_ids', {'iface-id': 'e606a4ce-7ebe-46db-8e2b-71dc2ee247a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:dd:69', 'vm-uuid': '934e9b7f-8bb4-4487-83cd-c5fbc92daefc'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: INFO os_vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:dd:69,bridge_name='br-int',has_traffic_filtering=True,id=e606a4ce-7ebe-46db-8e2b-71dc2ee247a1,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape606a4ce-7e')
Nov 07 15:24:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af3cc600-3a36-42ec-8976-b1c950150d96", "address": "fa:16:3e:81:53:e5", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cc600-3a", "ovs_interfaceid": "af3cc600-3a36-42ec-8976-b1c950150d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "af3cc600-3a36-42ec-8976-b1c950150d96", "address": "fa:16:3e:81:53:e5", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cc600-3a", "ovs_interfaceid": "af3cc600-3a36-42ec-8976-b1c950150d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:53:e5,bridge_name='br-int',has_traffic_filtering=True,id=af3cc600-3a36-42ec-8976-b1c950150d96,network=Network(52802d24-4900-4a5b-a787-9d62114be5fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3cc600-3a') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG os_vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:53:e5,bridge_name='br-int',has_traffic_filtering=True,id=af3cc600-3a36-42ec-8976-b1c950150d96,network=Network(52802d24-4900-4a5b-a787-9d62114be5fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3cc600-3a') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cb8d487-d966-569e-af0d-ba5a2755e733', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf3cc600-3a, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf3cc600-3a, col_values=(('qos', UUID('8eebe288-1ea5-4411-a538-bd7f3ca6e2b2')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf3cc600-3a, col_values=(('external_ids', {'iface-id': 'af3cc600-3a36-42ec-8976-b1c950150d96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:53:e5', 'vm-uuid': '934e9b7f-8bb4-4487-83cd-c5fbc92daefc'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: INFO os_vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:53:e5,bridge_name='br-int',has_traffic_filtering=True,id=af3cc600-3a36-42ec-8976-b1c950150d96,network=Network(52802d24-4900-4a5b-a787-9d62114be5fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3cc600-3a')
Nov 07 15:24:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c265f2ff-01fc-4405-81dc-7612ee11764e", "address": "fa:16:3e:6c:fc:63", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc265f2ff-01", "ovs_interfaceid": "c265f2ff-01fc-4405-81dc-7612ee11764e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "c265f2ff-01fc-4405-81dc-7612ee11764e", "address": "fa:16:3e:6c:fc:63", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc265f2ff-01", "ovs_interfaceid": "c265f2ff-01fc-4405-81dc-7612ee11764e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fc:63,bridge_name='br-int',has_traffic_filtering=True,id=c265f2ff-01fc-4405-81dc-7612ee11764e,network=Network(52802d24-4900-4a5b-a787-9d62114be5fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc265f2ff-01') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG os_vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fc:63,bridge_name='br-int',has_traffic_filtering=True,id=c265f2ff-01fc-4405-81dc-7612ee11764e,network=Network(52802d24-4900-4a5b-a787-9d62114be5fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc265f2ff-01') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '352405b0-6b15-52d2-ae71-d33768ebd3a7', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc265f2ff-01, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc265f2ff-01, col_values=(('qos', UUID('1c1a7f84-a1b9-4bea-b04a-9024523142e9')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc265f2ff-01, col_values=(('external_ids', {'iface-id': 'c265f2ff-01fc-4405-81dc-7612ee11764e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:fc:63', 'vm-uuid': '934e9b7f-8bb4-4487-83cd-c5fbc92daefc'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:11 user nova-compute[75018]: INFO os_vif [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fc:63,bridge_name='br-int',has_traffic_filtering=True,id=c265f2ff-01fc-4405-81dc-7612ee11764e,network=Network(52802d24-4900-4a5b-a787-9d62114be5fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc265f2ff-01')
Nov 07 15:24:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] No BDM found with device name hda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] No VIF found with MAC fa:16:3e:3f:70:d2, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] No VIF found with MAC fa:16:3e:4b:dd:69, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:24:11 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Using config drive
Nov 07 15:24:11 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Creating config drive at /opt/stack/data/nova/instances/934e9b7f-8bb4-4487-83cd-c5fbc92daefc/disk.config
Nov 07 15:24:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/934e9b7f-8bb4-4487-83cd-c5fbc92daefc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptrj44hpq {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/934e9b7f-8bb4-4487-83cd-c5fbc92daefc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptrj44hpq" returned: 0 in 0.051s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] <== connect_volume: return (1810ms) {'type': 'block', 'scsi_wwn': '26263623635343761', 'path': '/dev/sdi'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263623635343761', 'path': '/dev/sdi'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.481s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:12 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:12 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG nova.objects.instance [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lazy-loading 'flavor' on Instance uuid d5341681-9ba6-4f21-a67c-00d50aea8762 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b9d846-cda5-40aa-8bfb-b874233d9879]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:24:12 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] attach device xml: <disk type="block" device="disk">
Nov 07 15:24:12 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:12 user nova-compute[75018]:   <source dev="/dev/sdi"/>
Nov 07 15:24:12 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:24:12 user nova-compute[75018]:   <serial>14ee9fe1-1cb0-4307-a92f-81baa76d5e6c</serial>
Nov 07 15:24:12 user nova-compute[75018]: </disk>
Nov 07 15:24:12 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6f9481-6b88-42d4-b62f-0e7af592734c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042] added
Nov 07 15:24:12 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae6f0dd-2b9c-4b51-b2a6-bb21fd329c15]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b7da24-427d-40a7-bb9d-d963e90ee5b2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ORALivPQ {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ORALivPQ" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2e69f8-26f1-4584-bfe1-85b58a67ac6a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ORALivPQ'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcc29d6-facc-4405-aacc-14f84d2afd79]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[847bc6b3-a0b0-4206-8f40-4f686c6147f8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b36285-6d45-4261-90b3-8d3eede68cad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042, portal: 172.16.0.220,3260]
Nov 07 15:24:12 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042, portal: 172.16.0.220,3260] successful.
Nov 07 15:24:12 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d05740-b316-4d9d-8a26-70975a923cc5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a384c7-fea3-4731-bfff-e6d6e465ae0f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:12 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e84e80f-3664-4501-b7bc-cb1977d2738e]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:24:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORALivPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] No VIF found with MAC fa:16:3e:5c:7f:f5, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b7987dc-2ef1-4ddc-89c6-99a166abcbe2 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.311s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] <== connect_volume: return (2909ms) {'type': 'block', 'scsi_wwn': '23730383833353833', 'path': '/dev/sdj'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730383833353833', 'path': '/dev/sdj'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjBQJsLA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:13 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:13 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:13 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3fa012-7958-4a7a-af40-ea4994036bd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:24:13 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cca3065-4895-486d-8ca4-c0a3ad5c62f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6] added
Nov 07 15:24:13 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43c8eab-382d-4d84-b505-5cfe9d725407]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d2eedd-f815-44fb-8a5f-4c636a11ad81]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjBQJsLA {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjBQJsLA" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cf22b0-5308-4d26-aa27-db4709af6381]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hjBQJsLA'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0538637a-b3e2-4411-a61c-4434cc90d923]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c416a28f-ccec-4047-a561-f5d8c7bb1713]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.120s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1431c1fc-06be-4793-8a46-d63bbf4b8297]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6, portal: 172.16.0.220,3260]
Nov 07 15:24:13 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6, portal: 172.16.0.220,3260] successful.
Nov 07 15:24:13 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d194d0-066d-4f6e-8e36-1abb05a4fcb4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29df64e-81d3-46f7-8146-9f391fe8573c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:13 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:24:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a770fde2-0bb0-4e7a-b3b9-445432952992]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG nova.compute.manager [req-549becba-482e-4c37-840f-ea397018fe09 req-8fdfcc75-16f5-4d48-b717-18e46094dc62 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-549becba-482e-4c37-840f-ea397018fe09 req-8fdfcc75-16f5-4d48-b717-18e46094dc62 service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-549becba-482e-4c37-840f-ea397018fe09 req-8fdfcc75-16f5-4d48-b717-18e46094dc62 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-549becba-482e-4c37-840f-ea397018fe09 req-8fdfcc75-16f5-4d48-b717-18e46094dc62 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG nova.compute.manager [req-549becba-482e-4c37-840f-ea397018fe09 req-8fdfcc75-16f5-4d48-b717-18e46094dc62 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:14 user nova-compute[75018]: WARNING nova.compute.manager [req-549becba-482e-4c37-840f-ea397018fe09 req-8fdfcc75-16f5-4d48-b717-18e46094dc62 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-82c43c00-84c9-470a-b788-2372caaad4b2 for instance with vm_state building and task_state spawning.
Nov 07 15:24:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG nova.compute.manager [req-66a1de17-8220-40a2-9ef7-6e4b46604c9a req-bf0742ac-a5f6-44ba-a6be-607df0ddd22c service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-17ab878f-bcba-42bf-a4ed-15517fa5e244 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-66a1de17-8220-40a2-9ef7-6e4b46604c9a req-bf0742ac-a5f6-44ba-a6be-607df0ddd22c service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-66a1de17-8220-40a2-9ef7-6e4b46604c9a req-bf0742ac-a5f6-44ba-a6be-607df0ddd22c service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-66a1de17-8220-40a2-9ef7-6e4b46604c9a req-bf0742ac-a5f6-44ba-a6be-607df0ddd22c service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG nova.compute.manager [req-66a1de17-8220-40a2-9ef7-6e4b46604c9a req-bf0742ac-a5f6-44ba-a6be-607df0ddd22c service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-17ab878f-bcba-42bf-a4ed-15517fa5e244 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:14 user nova-compute[75018]: WARNING nova.compute.manager [req-66a1de17-8220-40a2-9ef7-6e4b46604c9a req-bf0742ac-a5f6-44ba-a6be-607df0ddd22c service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-17ab878f-bcba-42bf-a4ed-15517fa5e244 for instance with vm_state building and task_state spawning.
Nov 07 15:24:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG nova.compute.manager [req-a20abeea-1b46-47fc-aee8-9969e795eb22 req-c292ee42-b3c0-4ca9-953f-ab7a9a8ac9d8 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-56f2d51d-5593-464f-b7da-df1c81449a23 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a20abeea-1b46-47fc-aee8-9969e795eb22 req-c292ee42-b3c0-4ca9-953f-ab7a9a8ac9d8 service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a20abeea-1b46-47fc-aee8-9969e795eb22 req-c292ee42-b3c0-4ca9-953f-ab7a9a8ac9d8 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a20abeea-1b46-47fc-aee8-9969e795eb22 req-c292ee42-b3c0-4ca9-953f-ab7a9a8ac9d8 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG nova.compute.manager [req-a20abeea-1b46-47fc-aee8-9969e795eb22 req-c292ee42-b3c0-4ca9-953f-ab7a9a8ac9d8 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-56f2d51d-5593-464f-b7da-df1c81449a23 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:14 user nova-compute[75018]: WARNING nova.compute.manager [req-a20abeea-1b46-47fc-aee8-9969e795eb22 req-c292ee42-b3c0-4ca9-953f-ab7a9a8ac9d8 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-56f2d51d-5593-464f-b7da-df1c81449a23 for instance with vm_state building and task_state spawning.
Nov 07 15:24:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5377261f-30d1-454d-ae37-4a8af966629c tempest-VolumesAssistedSnapshotsTest-1009615934 tempest-VolumesAssistedSnapshotsTest-1009615934-project] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] volume_snapshot_create: create_info: {'snapshot_id': '10a651f6-56e9-4dcd-97c0-d3ba8c6ea9b8', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75018) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5377261f-30d1-454d-ae37-4a8af966629c tempest-VolumesAssistedSnapshotsTest-1009615934 tempest-VolumesAssistedSnapshotsTest-1009615934-project] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] snap xml: <domainsnapshot>
Nov 07 15:24:14 user nova-compute[75018]:   <disks>
Nov 07 15:24:14 user nova-compute[75018]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 07 15:24:14 user nova-compute[75018]:       <source file="/dev/new_file"/>
Nov 07 15:24:14 user nova-compute[75018]:     </disk>
Nov 07 15:24:14 user nova-compute[75018]:     <disk name="vda" snapshot="no"/>
Nov 07 15:24:14 user nova-compute[75018]:   </disks>
Nov 07 15:24:14 user nova-compute[75018]: </domainsnapshot>
Nov 07 15:24:14 user nova-compute[75018]:  {{(pid=75018) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG nova.objects.instance [None req-5377261f-30d1-454d-ae37-4a8af966629c tempest-VolumesAssistedSnapshotsTest-1009615934 tempest-VolumesAssistedSnapshotsTest-1009615934-project] Lazy-loading 'system_metadata' on Instance uuid d5341681-9ba6-4f21-a67c-00d50aea8762 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:14 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-5377261f-30d1-454d-ae37-4a8af966629c tempest-VolumesAssistedSnapshotsTest-1009615934 tempest-VolumesAssistedSnapshotsTest-1009615934-project] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [None req-5377261f-30d1-454d-ae37-4a8af966629c tempest-VolumesAssistedSnapshotsTest-1009615934 tempest-VolumesAssistedSnapshotsTest-1009615934-project] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Traceback (most recent call last):
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     rv = execute(f, *args, **kwargs)
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     six.reraise(c, e, tb)
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     raise value
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     rv = meth(*args, **kwargs)
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] 
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [None req-5377261f-30d1-454d-ae37-4a8af966629c tempest-VolumesAssistedSnapshotsTest-1009615934 tempest-VolumesAssistedSnapshotsTest-1009615934-project] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Traceback (most recent call last):
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     self._volume_snapshot_create(context, instance, guest,
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     rv = execute(f, *args, **kwargs)
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     six.reraise(c, e, tb)
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     raise value
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     rv = meth(*args, **kwargs)
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] 
Nov 07 15:24:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6ec73bcc-f1dc-4212-9fe2-e8d12d300bee tempest-VolumesAssistedSnapshotsTest-1009615934 tempest-VolumesAssistedSnapshotsTest-1009615934-project] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] volume_snapshot_delete: delete_info: {'volume_id': '14ee9fe1-1cb0-4307-a92f-81baa76d5e6c'} {{(pid=75018) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [None req-6ec73bcc-f1dc-4212-9fe2-e8d12d300bee tempest-VolumesAssistedSnapshotsTest-1009615934 tempest-VolumesAssistedSnapshotsTest-1009615934-project] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Traceback (most recent call last):
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762]     if delete_info['type'] != 'qcow2':
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] KeyError: 'type'
Nov 07 15:24:14 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] 
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjBQJsLA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '23364323461333234', 'path': '/dev/sdk'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364323461333234', 'path': '/dev/sdk'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [None req-5377261f-30d1-454d-ae37-4a8af966629c tempest-VolumesAssistedSnapshotsTest-1009615934 tempest-VolumesAssistedSnapshotsTest-1009615934-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 10a651f6-56e9-4dcd-97c0-d3ba8c6ea9b8 could not be found.
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     raise value
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver 
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver 
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 10a651f6-56e9-4dcd-97c0-d3ba8c6ea9b8 could not be found. (HTTP 404) (Request-ID: req-227ff259-1bfd-4e7a-b887-8d298bc3b40e)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver 
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver 
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 10a651f6-56e9-4dcd-97c0-d3ba8c6ea9b8 could not be found.
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver 
Nov 07 15:24:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQeokpqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:15 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:15 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:15 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server [None req-5377261f-30d1-454d-ae37-4a8af966629c tempest-VolumesAssistedSnapshotsTest-1009615934 tempest-VolumesAssistedSnapshotsTest-1009615934-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     raise value
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server 
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver [None req-6ec73bcc-f1dc-4212-9fe2-e8d12d300bee tempest-VolumesAssistedSnapshotsTest-1009615934 tempest-VolumesAssistedSnapshotsTest-1009615934-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver 
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver 
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-c8c02b37-960b-4234-8beb-ec26acc0d1ae)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver 
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver 
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 07 15:24:15 user nova-compute[75018]: ERROR nova.virt.libvirt.driver 
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server [None req-6ec73bcc-f1dc-4212-9fe2-e8d12d300bee tempest-VolumesAssistedSnapshotsTest-1009615934 tempest-VolumesAssistedSnapshotsTest-1009615934-project] Exception during message handling: KeyError: 'type'
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 07 15:24:15 user nova-compute[75018]: ERROR oslo_messaging.rpc.server 
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260" returned: 21 in 0.059s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94489f9-916c-4bf6-9181-5579b0669630]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:24:15 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fcdd7d-7d44-4003-bc23-8091afc3b6ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a] added
Nov 07 15:24:15 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.143s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff2f7dd-7687-4a99-ad99-cca60c418dbf]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4df32e-5a2c-4b0b-94e8-c514be5434ba]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQeokpqR {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQeokpqR" returned: 0 in 0.044s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fd6007-3e70-4558-a2db-9f5e193b9c51]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AQeokpqR'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae107d52-9bf0-483c-b392-0fc307fbd5ac]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3ee8d3-bdb0-48d9-bdaa-da81a57a131b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Acquiring lock "d5341681-9ba6-4f21-a67c-00d50aea8762" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:15 user nova-compute[75018]: INFO nova.compute.manager [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Detaching volume 14ee9fe1-1cb0-4307-a92f-81baa76d5e6c
Nov 07 15:24:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:15 user nova-compute[75018]: INFO nova.virt.block_device [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Attempting to driver detach volume 14ee9fe1-1cb0-4307-a92f-81baa76d5e6c from mountpoint /dev/vdb
Nov 07 15:24:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Attempting to detach device vdb from instance d5341681-9ba6-4f21-a67c-00d50aea8762 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] detach device xml: <disk type="block" device="disk">
Nov 07 15:24:15 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:15 user nova-compute[75018]:   <source dev="/dev/sdi"/>
Nov 07 15:24:15 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:24:15 user nova-compute[75018]:   <serial>14ee9fe1-1cb0-4307-a92f-81baa76d5e6c</serial>
Nov 07 15:24:15 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:24:15 user nova-compute[75018]: </disk>
Nov 07 15:24:15 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --login" returned: 0 in 0.138s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8702b8e-f12d-4a9b-9bbd-c96673a96f5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a, portal: 172.16.0.220,3260]
Nov 07 15:24:15 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a, portal: 172.16.0.220,3260] successful.
Nov 07 15:24:15 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:15 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Successfully detached device vdb from instance d5341681-9ba6-4f21-a67c-00d50aea8762 from the persistent domain config.
Nov 07 15:24:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d5341681-9ba6-4f21-a67c-00d50aea8762 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] detach device xml: <disk type="block" device="disk">
Nov 07 15:24:15 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:15 user nova-compute[75018]:   <source dev="/dev/sdi"/>
Nov 07 15:24:15 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:24:15 user nova-compute[75018]:   <serial>14ee9fe1-1cb0-4307-a92f-81baa76d5e6c</serial>
Nov 07 15:24:15 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:24:15 user nova-compute[75018]: </disk>
Nov 07 15:24:15 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f19c242-113b-4d2f-ada6-98c8d07dcb96]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9298a09-d39c-4449-8efc-0f4ce665bd0e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:15 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.792s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] HCTL ('43', '-', '-', 0) found on session 14 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[82324a9e-b8dd-4d80-8ebf-260a89db50a2]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Searching for a device in session 14 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQeokpqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:24:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:16 user nova-compute[75018]: WARNING nova.compute.manager [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-82c43c00-84c9-470a-b788-2372caaad4b2 for instance with vm_state building and task_state spawning.
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-f7d8a867-7f2c-4f73-8521-b2ec3f646045 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-f7d8a867-7f2c-4f73-8521-b2ec3f646045 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:16 user nova-compute[75018]: WARNING nova.compute.manager [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-f7d8a867-7f2c-4f73-8521-b2ec3f646045 for instance with vm_state building and task_state spawning.
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-f7d8a867-7f2c-4f73-8521-b2ec3f646045 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-f7d8a867-7f2c-4f73-8521-b2ec3f646045 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:16 user nova-compute[75018]: WARNING nova.compute.manager [req-f936f3e9-5fdb-4a60-8b95-df3308e1aaa2 req-5ce8a063-8fa8-47eb-a370-6580aca5c4fa service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-f7d8a867-7f2c-4f73-8521-b2ec3f646045 for instance with vm_state building and task_state spawning.
Nov 07 15:24:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d5341681-9ba6-4f21-a67c-00d50aea8762 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-17ab878f-bcba-42bf-a4ed-15517fa5e244 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-17ab878f-bcba-42bf-a4ed-15517fa5e244 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:16 user nova-compute[75018]: WARNING nova.compute.manager [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-17ab878f-bcba-42bf-a4ed-15517fa5e244 for instance with vm_state building and task_state spawning.
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-af3cc600-3a36-42ec-8976-b1c950150d96 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-af3cc600-3a36-42ec-8976-b1c950150d96 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:16 user nova-compute[75018]: WARNING nova.compute.manager [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-af3cc600-3a36-42ec-8976-b1c950150d96 for instance with vm_state building and task_state spawning.
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-af3cc600-3a36-42ec-8976-b1c950150d96 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-af3cc600-3a36-42ec-8976-b1c950150d96 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:16 user nova-compute[75018]: WARNING nova.compute.manager [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-af3cc600-3a36-42ec-8976-b1c950150d96 for instance with vm_state building and task_state spawning.
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-c265f2ff-01fc-4405-81dc-7612ee11764e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-c265f2ff-01fc-4405-81dc-7612ee11764e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:16 user nova-compute[75018]: WARNING nova.compute.manager [req-10c889f8-7df8-413e-ae1e-f8e37ad9f01f req-fc6eec47-65fb-4349-b91e-dab7b04145b2 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-c265f2ff-01fc-4405-81dc-7612ee11764e for instance with vm_state building and task_state spawning.
Nov 07 15:24:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-56f2d51d-5593-464f-b7da-df1c81449a23 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-56f2d51d-5593-464f-b7da-df1c81449a23 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:16 user nova-compute[75018]: WARNING nova.compute.manager [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-56f2d51d-5593-464f-b7da-df1c81449a23 for instance with vm_state building and task_state spawning.
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:16 user nova-compute[75018]: WARNING nova.compute.manager [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 for instance with vm_state building and task_state spawning.
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:16 user nova-compute[75018]: WARNING nova.compute.manager [req-1815da2f-f471-496e-8697-1aaebf568155 req-730aff84-c808-40c5-9f74-7fe695ec36dc service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 for instance with vm_state building and task_state spawning.
Nov 07 15:24:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.880s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] <== connect_volume: return (1883ms) {'type': 'block', 'scsi_wwn': '23338363539613165', 'path': '/dev/sdl'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338363539613165', 'path': '/dev/sdl'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73054878-c401-487b-8a75-1a637723b058", "address": "fa:16:3e:e7:75:3b", "network": {"id": "b4f2a6c5-feec-4805-869e-2ede50c3990d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232412547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73054878-c4", "ovs_interfaceid": "73054878-c401-487b-8a75-1a637723b058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "73054878-c401-487b-8a75-1a637723b058", "address": "fa:16:3e:e7:75:3b", "network": {"id": "b4f2a6c5-feec-4805-869e-2ede50c3990d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232412547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73054878-c4", "ovs_interfaceid": "73054878-c401-487b-8a75-1a637723b058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:75:3b,bridge_name='br-int',has_traffic_filtering=True,id=73054878-c401-487b-8a75-1a637723b058,network=Network(b4f2a6c5-feec-4805-869e-2ede50c3990d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73054878-c4') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c0:d9,bridge_name='br-int',has_traffic_filtering=True,id=98461dfb-9088-430a-bf24-dd855ff7175b,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98461dfb-90') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:38:52,bridge_name='br-int',has_traffic_filtering=True,id=d1383062-7e89-4ca1-a140-27490e36d621,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1383062-7e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:fb:92,bridge_name='br-int',has_traffic_filtering=True,id=5a2e7ee9-58c4-46e3-8f31-961dfb488150,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e7ee9-58') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0961679c-4367-4cb0-b7f8-b763408f97c6", "address": "fa:16:3e:4f:9a:a7", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0961679c-43", "ovs_interfaceid": "0961679c-4367-4cb0-b7f8-b763408f97c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "0961679c-4367-4cb0-b7f8-b763408f97c6", "address": "fa:16:3e:4f:9a:a7", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0961679c-43", "ovs_interfaceid": "0961679c-4367-4cb0-b7f8-b763408f97c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9a:a7,bridge_name='br-int',has_traffic_filtering=True,id=0961679c-4367-4cb0-b7f8-b763408f97c6,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0961679c-43') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "address": "fa:16:3e:e6:8a:29", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda084a72-6e", "ovs_interfaceid": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "address": "fa:16:3e:e6:8a:29", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda084a72-6e", "ovs_interfaceid": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8a:29,bridge_name='br-int',has_traffic_filtering=True,id=da084a72-6ed7-46b9-960e-3f9cd2e0ebf6,network=Network(5bd166f6-af0c-4a90-8f62-a6c479f18e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda084a72-6e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "106cd061-e91b-4718-8c52-cbaf14defe8c", "address": "fa:16:3e:53:d7:da", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106cd061-e9", "ovs_interfaceid": "106cd061-e91b-4718-8c52-cbaf14defe8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "106cd061-e91b-4718-8c52-cbaf14defe8c", "address": "fa:16:3e:53:d7:da", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106cd061-e9", "ovs_interfaceid": "106cd061-e91b-4718-8c52-cbaf14defe8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=106cd061-e91b-4718-8c52-cbaf14defe8c,network=Network(5bd166f6-af0c-4a90-8f62-a6c479f18e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106cd061-e9') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.objects.instance [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lazy-loading 'pci_devices' on Instance uuid 44f8bf0d-9714-45cf-8f71-206a8bb75a3a {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:24:17 user nova-compute[75018]:   <uuid>44f8bf0d-9714-45cf-8f71-206a8bb75a3a</uuid>
Nov 07 15:24:17 user nova-compute[75018]:   <name>instance-0000000c</name>
Nov 07 15:24:17 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:24:17 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:24:17 user nova-compute[75018]:   <metadata>
Nov 07 15:24:17 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:24:17 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:24:17 user nova-compute[75018]:       <nova:name>tempest-device-tagging-server-50242220</nova:name>
Nov 07 15:24:17 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:24:10</nova:creationTime>
Nov 07 15:24:17 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:24:17 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:24:17 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:24:17 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:24:17 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:24:17 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:24:17 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:24:17 user nova-compute[75018]:       <nova:owner>
Nov 07 15:24:17 user nova-compute[75018]:         <nova:user uuid="ac6aff2e0eae4806bb862abfb9f31d0b">tempest-TaggedBootDevicesTest-224611665-project-member</nova:user>
Nov 07 15:24:17 user nova-compute[75018]:         <nova:project uuid="9973265f38de417c9af4de9eb09ce262">tempest-TaggedBootDevicesTest-224611665</nova:project>
Nov 07 15:24:17 user nova-compute[75018]:       </nova:owner>
Nov 07 15:24:17 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:24:17 user nova-compute[75018]:       <nova:ports>
Nov 07 15:24:17 user nova-compute[75018]:         <nova:port uuid="73054878-c401-487b-8a75-1a637723b058">
Nov 07 15:24:17 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 07 15:24:17 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:17 user nova-compute[75018]:         <nova:port uuid="98461dfb-9088-430a-bf24-dd855ff7175b">
Nov 07 15:24:17 user nova-compute[75018]:           <nova:ip type="fixed" address="10.1.1.17" ipVersion="4"/>
Nov 07 15:24:17 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:17 user nova-compute[75018]:         <nova:port uuid="d1383062-7e89-4ca1-a140-27490e36d621">
Nov 07 15:24:17 user nova-compute[75018]:           <nova:ip type="fixed" address="10.1.1.229" ipVersion="4"/>
Nov 07 15:24:17 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:17 user nova-compute[75018]:         <nova:port uuid="5a2e7ee9-58c4-46e3-8f31-961dfb488150">
Nov 07 15:24:17 user nova-compute[75018]:           <nova:ip type="fixed" address="10.1.1.105" ipVersion="4"/>
Nov 07 15:24:17 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:17 user nova-compute[75018]:         <nova:port uuid="0961679c-4367-4cb0-b7f8-b763408f97c6">
Nov 07 15:24:17 user nova-compute[75018]:           <nova:ip type="fixed" address="10.1.1.142" ipVersion="4"/>
Nov 07 15:24:17 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:17 user nova-compute[75018]:         <nova:port uuid="da084a72-6ed7-46b9-960e-3f9cd2e0ebf6">
Nov 07 15:24:17 user nova-compute[75018]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 07 15:24:17 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:17 user nova-compute[75018]:         <nova:port uuid="106cd061-e91b-4718-8c52-cbaf14defe8c">
Nov 07 15:24:17 user nova-compute[75018]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 07 15:24:17 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:17 user nova-compute[75018]:       </nova:ports>
Nov 07 15:24:17 user nova-compute[75018]:     </nova:instance>
Nov 07 15:24:17 user nova-compute[75018]:   </metadata>
Nov 07 15:24:17 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:24:17 user nova-compute[75018]:     <system>
Nov 07 15:24:17 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:24:17 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:24:17 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:24:17 user nova-compute[75018]:       <entry name="serial">44f8bf0d-9714-45cf-8f71-206a8bb75a3a</entry>
Nov 07 15:24:17 user nova-compute[75018]:       <entry name="uuid">44f8bf0d-9714-45cf-8f71-206a8bb75a3a</entry>
Nov 07 15:24:17 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:24:17 user nova-compute[75018]:     </system>
Nov 07 15:24:17 user nova-compute[75018]:   </sysinfo>
Nov 07 15:24:17 user nova-compute[75018]:   <os>
Nov 07 15:24:17 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:24:17 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:24:17 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:24:17 user nova-compute[75018]:   </os>
Nov 07 15:24:17 user nova-compute[75018]:   <features>
Nov 07 15:24:17 user nova-compute[75018]:     <acpi/>
Nov 07 15:24:17 user nova-compute[75018]:     <apic/>
Nov 07 15:24:17 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:24:17 user nova-compute[75018]:   </features>
Nov 07 15:24:17 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:24:17 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:24:17 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:24:17 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:24:17 user nova-compute[75018]:   </clock>
Nov 07 15:24:17 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:24:17 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:24:17 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:24:17 user nova-compute[75018]:   </cpu>
Nov 07 15:24:17 user nova-compute[75018]:   <devices>
Nov 07 15:24:17 user nova-compute[75018]:     <disk type="file" device="cdrom">
Nov 07 15:24:17 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none"/>
Nov 07 15:24:17 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/44f8bf0d-9714-45cf-8f71-206a8bb75a3a/disk.config"/>
Nov 07 15:24:17 user nova-compute[75018]:       <target dev="hda" bus="ide"/>
Nov 07 15:24:17 user nova-compute[75018]:     </disk>
Nov 07 15:24:17 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:24:17 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:17 user nova-compute[75018]:       <source dev="/dev/sdj"/>
Nov 07 15:24:17 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:24:17 user nova-compute[75018]:       <serial>52a3ccb9-d419-4301-b804-fb5c6a8e4042</serial>
Nov 07 15:24:17 user nova-compute[75018]:     </disk>
Nov 07 15:24:17 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:24:17 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:17 user nova-compute[75018]:       <source dev="/dev/sdk"/>
Nov 07 15:24:17 user nova-compute[75018]:       <target dev="vdb" bus="virtio"/>
Nov 07 15:24:17 user nova-compute[75018]:       <serial>37beef21-da5e-4cfb-8dae-11c45d37d1d6</serial>
Nov 07 15:24:17 user nova-compute[75018]:     </disk>
Nov 07 15:24:17 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:24:17 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:17 user nova-compute[75018]:       <source dev="/dev/sdl"/>
Nov 07 15:24:17 user nova-compute[75018]:       <target dev="vdc" bus="virtio"/>
Nov 07 15:24:17 user nova-compute[75018]:       <serial>d102cc69-aac9-407f-b1f3-5b9d70fa7b5a</serial>
Nov 07 15:24:17 user nova-compute[75018]:     </disk>
Nov 07 15:24:17 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:17 user nova-compute[75018]:       <mac address="fa:16:3e:e7:75:3b"/>
Nov 07 15:24:17 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:17 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:17 user nova-compute[75018]:       <target dev="tap73054878-c4"/>
Nov 07 15:24:17 user nova-compute[75018]:     </interface>
Nov 07 15:24:17 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:17 user nova-compute[75018]:       <mac address="fa:16:3e:05:c0:d9"/>
Nov 07 15:24:17 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:17 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:17 user nova-compute[75018]:       <target dev="tap98461dfb-90"/>
Nov 07 15:24:17 user nova-compute[75018]:     </interface>
Nov 07 15:24:17 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:17 user nova-compute[75018]:       <mac address="fa:16:3e:ae:38:52"/>
Nov 07 15:24:17 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:17 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:17 user nova-compute[75018]:       <target dev="tapd1383062-7e"/>
Nov 07 15:24:17 user nova-compute[75018]:     </interface>
Nov 07 15:24:17 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:17 user nova-compute[75018]:       <mac address="fa:16:3e:93:fb:92"/>
Nov 07 15:24:17 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:17 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:17 user nova-compute[75018]:       <target dev="tap5a2e7ee9-58"/>
Nov 07 15:24:17 user nova-compute[75018]:     </interface>
Nov 07 15:24:17 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:17 user nova-compute[75018]:       <mac address="fa:16:3e:4f:9a:a7"/>
Nov 07 15:24:17 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:17 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:17 user nova-compute[75018]:       <target dev="tap0961679c-43"/>
Nov 07 15:24:17 user nova-compute[75018]:     </interface>
Nov 07 15:24:17 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:17 user nova-compute[75018]:       <mac address="fa:16:3e:e6:8a:29"/>
Nov 07 15:24:17 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:17 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:17 user nova-compute[75018]:       <target dev="tapda084a72-6e"/>
Nov 07 15:24:17 user nova-compute[75018]:     </interface>
Nov 07 15:24:17 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:17 user nova-compute[75018]:       <mac address="fa:16:3e:53:d7:da"/>
Nov 07 15:24:17 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:17 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:17 user nova-compute[75018]:       <target dev="tap106cd061-e9"/>
Nov 07 15:24:17 user nova-compute[75018]:     </interface>
Nov 07 15:24:17 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:24:17 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/44f8bf0d-9714-45cf-8f71-206a8bb75a3a/console.log" append="off"/>
Nov 07 15:24:17 user nova-compute[75018]:     </serial>
Nov 07 15:24:17 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:24:17 user nova-compute[75018]:     <video>
Nov 07 15:24:17 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:17 user nova-compute[75018]:     </video>
Nov 07 15:24:17 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:24:17 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:24:17 user nova-compute[75018]:     </rng>
Nov 07 15:24:17 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:24:17 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:24:17 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:24:17 user nova-compute[75018]:     </memballoon>
Nov 07 15:24:17 user nova-compute[75018]:   </devices>
Nov 07 15:24:17 user nova-compute[75018]: </domain>
Nov 07 15:24:17 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73054878-c401-487b-8a75-1a637723b058", "address": "fa:16:3e:e7:75:3b", "network": {"id": "b4f2a6c5-feec-4805-869e-2ede50c3990d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232412547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73054878-c4", "ovs_interfaceid": "73054878-c401-487b-8a75-1a637723b058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "73054878-c401-487b-8a75-1a637723b058", "address": "fa:16:3e:e7:75:3b", "network": {"id": "b4f2a6c5-feec-4805-869e-2ede50c3990d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232412547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73054878-c4", "ovs_interfaceid": "73054878-c401-487b-8a75-1a637723b058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:75:3b,bridge_name='br-int',has_traffic_filtering=True,id=73054878-c401-487b-8a75-1a637723b058,network=Network(b4f2a6c5-feec-4805-869e-2ede50c3990d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73054878-c4') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG os_vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:75:3b,bridge_name='br-int',has_traffic_filtering=True,id=73054878-c401-487b-8a75-1a637723b058,network=Network(b4f2a6c5-feec-4805-869e-2ede50c3990d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73054878-c4') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '155bf1cb-1048-5b87-b72a-5bb3a8ba40d6', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73054878-c4, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73054878-c4, col_values=(('qos', UUID('7947116d-a282-4789-94ae-5bac53b97a57')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73054878-c4, col_values=(('external_ids', {'iface-id': '73054878-c401-487b-8a75-1a637723b058', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:75:3b', 'vm-uuid': '44f8bf0d-9714-45cf-8f71-206a8bb75a3a'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: INFO os_vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:75:3b,bridge_name='br-int',has_traffic_filtering=True,id=73054878-c401-487b-8a75-1a637723b058,network=Network(b4f2a6c5-feec-4805-869e-2ede50c3990d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73054878-c4')
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c0:d9,bridge_name='br-int',has_traffic_filtering=True,id=98461dfb-9088-430a-bf24-dd855ff7175b,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98461dfb-90') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG os_vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c0:d9,bridge_name='br-int',has_traffic_filtering=True,id=98461dfb-9088-430a-bf24-dd855ff7175b,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98461dfb-90') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '461a0e42-ef39-5368-a6f1-19358be655ae', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98461dfb-90, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98461dfb-90, col_values=(('qos', UUID('748dfe2b-7ad2-47e6-8742-4ebbd6f3ad79')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98461dfb-90, col_values=(('external_ids', {'iface-id': '98461dfb-9088-430a-bf24-dd855ff7175b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:c0:d9', 'vm-uuid': '44f8bf0d-9714-45cf-8f71-206a8bb75a3a'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: INFO os_vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c0:d9,bridge_name='br-int',has_traffic_filtering=True,id=98461dfb-9088-430a-bf24-dd855ff7175b,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98461dfb-90')
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:38:52,bridge_name='br-int',has_traffic_filtering=True,id=d1383062-7e89-4ca1-a140-27490e36d621,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1383062-7e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG os_vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:38:52,bridge_name='br-int',has_traffic_filtering=True,id=d1383062-7e89-4ca1-a140-27490e36d621,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1383062-7e') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f61fdaac-5de5-5d3c-a7e8-c7badd4d4a50', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1383062-7e, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1383062-7e, col_values=(('qos', UUID('b7bcbe0c-7752-4a25-a928-26dd87fff788')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1383062-7e, col_values=(('external_ids', {'iface-id': 'd1383062-7e89-4ca1-a140-27490e36d621', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:38:52', 'vm-uuid': '44f8bf0d-9714-45cf-8f71-206a8bb75a3a'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: INFO os_vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:38:52,bridge_name='br-int',has_traffic_filtering=True,id=d1383062-7e89-4ca1-a140-27490e36d621,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1383062-7e')
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:fb:92,bridge_name='br-int',has_traffic_filtering=True,id=5a2e7ee9-58c4-46e3-8f31-961dfb488150,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e7ee9-58') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG os_vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:fb:92,bridge_name='br-int',has_traffic_filtering=True,id=5a2e7ee9-58c4-46e3-8f31-961dfb488150,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e7ee9-58') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '114757a7-c144-589e-bf94-440700338ac3', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a2e7ee9-58, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a2e7ee9-58, col_values=(('qos', UUID('fd4e511f-e8fb-4324-8a67-6507ba63d74f')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a2e7ee9-58, col_values=(('external_ids', {'iface-id': '5a2e7ee9-58c4-46e3-8f31-961dfb488150', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:fb:92', 'vm-uuid': '44f8bf0d-9714-45cf-8f71-206a8bb75a3a'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: INFO os_vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:fb:92,bridge_name='br-int',has_traffic_filtering=True,id=5a2e7ee9-58c4-46e3-8f31-961dfb488150,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e7ee9-58')
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0961679c-4367-4cb0-b7f8-b763408f97c6", "address": "fa:16:3e:4f:9a:a7", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0961679c-43", "ovs_interfaceid": "0961679c-4367-4cb0-b7f8-b763408f97c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "0961679c-4367-4cb0-b7f8-b763408f97c6", "address": "fa:16:3e:4f:9a:a7", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0961679c-43", "ovs_interfaceid": "0961679c-4367-4cb0-b7f8-b763408f97c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9a:a7,bridge_name='br-int',has_traffic_filtering=True,id=0961679c-4367-4cb0-b7f8-b763408f97c6,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0961679c-43') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG os_vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9a:a7,bridge_name='br-int',has_traffic_filtering=True,id=0961679c-4367-4cb0-b7f8-b763408f97c6,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0961679c-43') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d7b2b7a-9eaa-5946-9841-c193eabbe564', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0961679c-43, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0961679c-43, col_values=(('qos', UUID('5b54e63c-2dc5-4c07-9cff-79a091eb0ec8')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0961679c-43, col_values=(('external_ids', {'iface-id': '0961679c-4367-4cb0-b7f8-b763408f97c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:9a:a7', 'vm-uuid': '44f8bf0d-9714-45cf-8f71-206a8bb75a3a'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: INFO os_vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9a:a7,bridge_name='br-int',has_traffic_filtering=True,id=0961679c-4367-4cb0-b7f8-b763408f97c6,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0961679c-43')
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "address": "fa:16:3e:e6:8a:29", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda084a72-6e", "ovs_interfaceid": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "address": "fa:16:3e:e6:8a:29", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda084a72-6e", "ovs_interfaceid": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8a:29,bridge_name='br-int',has_traffic_filtering=True,id=da084a72-6ed7-46b9-960e-3f9cd2e0ebf6,network=Network(5bd166f6-af0c-4a90-8f62-a6c479f18e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda084a72-6e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG os_vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8a:29,bridge_name='br-int',has_traffic_filtering=True,id=da084a72-6ed7-46b9-960e-3f9cd2e0ebf6,network=Network(5bd166f6-af0c-4a90-8f62-a6c479f18e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda084a72-6e') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d88df87-af7a-50f0-bc21-fcd05ea2ec61', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.objects.instance [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lazy-loading 'flavor' on Instance uuid 8257c590-204a-4fde-8487-79b8c0c87ea7 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda084a72-6e, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda084a72-6e, col_values=(('qos', UUID('ab44cd1b-8344-4c6f-99d9-db16bae60e2e')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda084a72-6e, col_values=(('external_ids', {'iface-id': 'da084a72-6ed7-46b9-960e-3f9cd2e0ebf6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:8a:29', 'vm-uuid': '44f8bf0d-9714-45cf-8f71-206a8bb75a3a'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: INFO os_vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8a:29,bridge_name='br-int',has_traffic_filtering=True,id=da084a72-6ed7-46b9-960e-3f9cd2e0ebf6,network=Network(5bd166f6-af0c-4a90-8f62-a6c479f18e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda084a72-6e')
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "106cd061-e91b-4718-8c52-cbaf14defe8c", "address": "fa:16:3e:53:d7:da", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106cd061-e9", "ovs_interfaceid": "106cd061-e91b-4718-8c52-cbaf14defe8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "106cd061-e91b-4718-8c52-cbaf14defe8c", "address": "fa:16:3e:53:d7:da", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106cd061-e9", "ovs_interfaceid": "106cd061-e91b-4718-8c52-cbaf14defe8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=106cd061-e91b-4718-8c52-cbaf14defe8c,network=Network(5bd166f6-af0c-4a90-8f62-a6c479f18e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106cd061-e9') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG os_vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=106cd061-e91b-4718-8c52-cbaf14defe8c,network=Network(5bd166f6-af0c-4a90-8f62-a6c479f18e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106cd061-e9') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8bb23db2-a58b-50ca-8206-4b0102b8e4d3', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:18 user nova-compute[75018]: INFO nova.compute.manager [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Attaching volume f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf to /dev/vdb
Nov 07 15:24:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap106cd061-e9, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap106cd061-e9, col_values=(('qos', UUID('0627ca2e-13da-4f90-951a-a1382cef47d8')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap106cd061-e9, col_values=(('external_ids', {'iface-id': '106cd061-e91b-4718-8c52-cbaf14defe8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:d7:da', 'vm-uuid': '44f8bf0d-9714-45cf-8f71-206a8bb75a3a'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:18 user nova-compute[75018]: INFO os_vif [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=106cd061-e91b-4718-8c52-cbaf14defe8c,network=Network(5bd166f6-af0c-4a90-8f62-a6c479f18e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106cd061-e9')
Nov 07 15:24:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG os_brick.utils [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd77cc2-4df1-4cf8-a96c-f6865392d88f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[706d4cbe-4004-4f5d-bd18-5b28317bd9a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad92ce3a-7091-4529-8baa-d99306bf8a0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4628ef5b-8060-4ef1-8d7e-8db93236e2ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:18 user nova-compute[75018]: INFO nova.compute.manager [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Unshelving
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] No BDM found with device name hda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] No VIF found with MAC fa:16:3e:e7:75:3b, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] No VIF found with MAC fa:16:3e:4f:9a:a7, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:24:18 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Using config drive
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:24:18 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[036d7e0b-a9a0-4456-bdad-97e194cd8fd7]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG os_brick.utils [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating existing volume attachment record: 9e14afeb-9040-4824-b6f0-b551edceca41 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:24:18 user nova-compute[75018]: INFO nova.virt.block_device [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Booting with volume a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 at /dev/vdc
Nov 07 15:24:18 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Creating config drive at /opt/stack/data/nova/instances/44f8bf0d-9714-45cf-8f71-206a8bb75a3a/disk.config
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/44f8bf0d-9714-45cf-8f71-206a8bb75a3a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8sv6s3yi {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/44f8bf0d-9714-45cf-8f71-206a8bb75a3a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8sv6s3yi" returned: 0 in 0.059s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.compute.manager [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:24:18 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Instance spawned successfully.
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-cba59d7d-4f0b-4255-985e-3f2218e90999 req-0a224abe-397f-4081-ab9a-55173adfa5b3 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-c265f2ff-01fc-4405-81dc-7612ee11764e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cba59d7d-4f0b-4255-985e-3f2218e90999 req-0a224abe-397f-4081-ab9a-55173adfa5b3 service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cba59d7d-4f0b-4255-985e-3f2218e90999 req-0a224abe-397f-4081-ab9a-55173adfa5b3 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cba59d7d-4f0b-4255-985e-3f2218e90999 req-0a224abe-397f-4081-ab9a-55173adfa5b3 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-cba59d7d-4f0b-4255-985e-3f2218e90999 req-0a224abe-397f-4081-ab9a-55173adfa5b3 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-c265f2ff-01fc-4405-81dc-7612ee11764e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:18 user nova-compute[75018]: WARNING nova.compute.manager [req-cba59d7d-4f0b-4255-985e-3f2218e90999 req-0a224abe-397f-4081-ab9a-55173adfa5b3 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-c265f2ff-01fc-4405-81dc-7612ee11764e for instance with vm_state building and task_state spawning.
Nov 07 15:24:19 user nova-compute[75018]: INFO nova.compute.manager [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Took 12.80 seconds to spawn the instance on the hypervisor.
Nov 07 15:24:19 user nova-compute[75018]: DEBUG nova.compute.manager [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:24:19 user nova-compute[75018]: INFO nova.compute.manager [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Took 116.08 seconds to build instance.
Nov 07 15:24:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-89f1a64f-75ba-45c9-8fbe-373b0f65afe4 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 116.185s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:19 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:24:19 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:24:19 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:24:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:19 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:24:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:20 user nova-compute[75018]: DEBUG nova.compute.manager [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Preparing to wait for external event volume-reimaged-cd6809db-5bfd-4f25-a699-665747ec0582 {{(pid=75018) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 07 15:24:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "5212605c-c913-483f-874b-17af335aeb2f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "5212605c-c913-483f-874b-17af335aeb2f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "5212605c-c913-483f-874b-17af335aeb2f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-76bde32d-2ca8-49ca-aee0-dc637ffeca60 req-32c2cc71-b511-4060-9bd3-9a508fcb427a service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-76bde32d-2ca8-49ca-aee0-dc637ffeca60 req-32c2cc71-b511-4060-9bd3-9a508fcb427a service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-76bde32d-2ca8-49ca-aee0-dc637ffeca60 req-32c2cc71-b511-4060-9bd3-9a508fcb427a service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-76bde32d-2ca8-49ca-aee0-dc637ffeca60 req-32c2cc71-b511-4060-9bd3-9a508fcb427a service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-76bde32d-2ca8-49ca-aee0-dc637ffeca60 req-32c2cc71-b511-4060-9bd3-9a508fcb427a service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:20 user nova-compute[75018]: WARNING nova.compute.manager [req-76bde32d-2ca8-49ca-aee0-dc637ffeca60 req-32c2cc71-b511-4060-9bd3-9a508fcb427a service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-73054878-c401-487b-8a75-1a637723b058 for instance with vm_state building and task_state spawning.
Nov 07 15:24:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.volume.cinder [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] Update attachment failed for attachment b46d2c5a-986d-4a50-9b4a-63164901ca96. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5663dd83-b8fb-4120-a05e-fc41f33f70a2) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5663dd83-b8fb-4120-a05e-fc41f33f70a2)
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Failed to connect to volume 37393f6f-9fd8-4d07-bc77-16c3a1c5f1d0 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5663dd83-b8fb-4120-a05e-fc41f33f70a2)
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Traceback (most recent call last):
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]     new_cinfo = self.volume_api.attachment_update(
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]     res = method(self, ctx, *args, **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]     with excutils.save_and_reraise_exception():
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]     self.force_reraise()
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]     raise self.value
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]     context, '3.44', skip_version_check=True).attachments.update(
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]     return method.func(obj, *args, **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]     resp = self._update('/attachments/%s' % id, body)
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]     return self._cs_request(url, 'PUT', **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]     return self.request(url, method, **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c]     raise exceptions.from_response(resp, body)
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5663dd83-b8fb-4120-a05e-fc41f33f70a2)
Nov 07 15:24:21 user nova-compute[75018]: ERROR nova.compute.manager [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] 
Nov 07 15:24:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG os_brick.utils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fd86ee-a580-40d7-9b64-c0275fcc3f33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Acquiring lock "22422ecc-1027-41c5-9bea-066fdc8ca995" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "22422ecc-1027-41c5-9bea-066fdc8ca995" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Acquiring lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:21 user nova-compute[75018]: INFO nova.compute.manager [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Terminating instance
Nov 07 15:24:21 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5af6f18-9471-49b9-b34d-19445bc61b6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[742ada5f-1a86-4710-9d2c-81c6bcc62bc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3545f752-d4f6-410a-8e6c-c2360ec10481]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:24:21 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d1f10e-1a03-453c-9eeb-36cbb1ddc82d]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG os_brick.utils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] <== get_connector_properties: return (229ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updating existing volume attachment record: 5159e6b7-7f98-491c-8e53-b492be8dbef6 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.077s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server [None req-2814758c-7860-4021-9d87-7f94814807cb tempest-TestVolumeSwap-1891757839 tempest-TestVolumeSwap-1891757839-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5663dd83-b8fb-4120-a05e-fc41f33f70a2)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7903, in swap_volume
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7901, in _do_locked_swap_volume
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7945, in _do_swap_volume
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7794, in _swap_volume
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5663dd83-b8fb-4120-a05e-fc41f33f70a2)
Nov 07 15:24:21 user nova-compute[75018]: ERROR oslo_messaging.rpc.server 
Nov 07 15:24:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:22 user nova-compute[75018]: WARNING nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-73054878-c401-487b-8a75-1a637723b058 for instance with vm_state building and task_state spawning.
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-98461dfb-9088-430a-bf24-dd855ff7175b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-98461dfb-9088-430a-bf24-dd855ff7175b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:22 user nova-compute[75018]: WARNING nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-98461dfb-9088-430a-bf24-dd855ff7175b for instance with vm_state building and task_state spawning.
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-98461dfb-9088-430a-bf24-dd855ff7175b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-98461dfb-9088-430a-bf24-dd855ff7175b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:22 user nova-compute[75018]: WARNING nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-98461dfb-9088-430a-bf24-dd855ff7175b for instance with vm_state building and task_state spawning.
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-d1383062-7e89-4ca1-a140-27490e36d621 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-d1383062-7e89-4ca1-a140-27490e36d621 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:22 user nova-compute[75018]: WARNING nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-d1383062-7e89-4ca1-a140-27490e36d621 for instance with vm_state building and task_state spawning.
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-d1383062-7e89-4ca1-a140-27490e36d621 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-d1383062-7e89-4ca1-a140-27490e36d621 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:22 user nova-compute[75018]: WARNING nova.compute.manager [req-3e745f76-7227-49a3-a96e-ba7964b023aa req-4959991c-1556-4ece-ba25-42cef6ced12e service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-d1383062-7e89-4ca1-a140-27490e36d621 for instance with vm_state building and task_state spawning.
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-e8af704d-deb6-4b51-8233-6561e57bc391 req-69367e21-c6ca-4055-b726-1d7ea5665fe7 service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Received event network-vif-unplugged-798cf71a-7966-4f68-b9ee-18e46b62c089 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e8af704d-deb6-4b51-8233-6561e57bc391 req-69367e21-c6ca-4055-b726-1d7ea5665fe7 service nova] Acquiring lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e8af704d-deb6-4b51-8233-6561e57bc391 req-69367e21-c6ca-4055-b726-1d7ea5665fe7 service nova] Lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e8af704d-deb6-4b51-8233-6561e57bc391 req-69367e21-c6ca-4055-b726-1d7ea5665fe7 service nova] Lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-e8af704d-deb6-4b51-8233-6561e57bc391 req-69367e21-c6ca-4055-b726-1d7ea5665fe7 service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] No waiting events found dispatching network-vif-unplugged-798cf71a-7966-4f68-b9ee-18e46b62c089 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-e8af704d-deb6-4b51-8233-6561e57bc391 req-69367e21-c6ca-4055-b726-1d7ea5665fe7 service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Received event network-vif-unplugged-798cf71a-7966-4f68-b9ee-18e46b62c089 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Instance destroyed successfully.
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.objects.instance [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lazy-loading 'resources' on Instance uuid 22422ecc-1027-41c5-9bea-066fdc8ca995 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1387159450',display_name='tempest-VolumesActionsTest-instance-1387159450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1387159450',id=8,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea5237b6bae4a6bb2f99aaa97f0a7a4',ramdisk_id='',reservation_id='r-c8v3pkrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1778955523',owner_user_name='tempest-VolumesActionsTest-1778955523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:21:20Z,user_data=None,user_id='281366ac5ac043f3957d5e1631da55fc',uuid=22422ecc-1027-41c5-9bea-066fdc8ca995,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "798cf71a-7966-4f68-b9ee-18e46b62c089", "address": "fa:16:3e:3a:85:3c", "network": {"id": "57e31aa5-49e6-4f0f-b380-474450060dbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-194571543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea5237b6bae4a6bb2f99aaa97f0a7a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf71a-79", "ovs_interfaceid": "798cf71a-7966-4f68-b9ee-18e46b62c089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Converting VIF {"id": "798cf71a-7966-4f68-b9ee-18e46b62c089", "address": "fa:16:3e:3a:85:3c", "network": {"id": "57e31aa5-49e6-4f0f-b380-474450060dbf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-194571543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea5237b6bae4a6bb2f99aaa97f0a7a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf71a-79", "ovs_interfaceid": "798cf71a-7966-4f68-b9ee-18e46b62c089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:85:3c,bridge_name='br-int',has_traffic_filtering=True,id=798cf71a-7966-4f68-b9ee-18e46b62c089,network=Network(57e31aa5-49e6-4f0f-b380-474450060dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798cf71a-79') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG os_vif [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:85:3c,bridge_name='br-int',has_traffic_filtering=True,id=798cf71a-7966-4f68-b9ee-18e46b62c089,network=Network(57e31aa5-49e6-4f0f-b380-474450060dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798cf71a-79') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap798cf71a-79, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=407bfc21-9ffb-47d2-a901-498c03db47b5) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:22 user nova-compute[75018]: INFO os_vif [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:85:3c,bridge_name='br-int',has_traffic_filtering=True,id=798cf71a-7966-4f68-b9ee-18e46b62c089,network=Network(57e31aa5-49e6-4f0f-b380-474450060dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798cf71a-79')
Nov 07 15:24:22 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Deleting instance files /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995_del
Nov 07 15:24:22 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Deletion of /opt/stack/data/nova/instances/22422ecc-1027-41c5-9bea-066fdc8ca995_del complete
Nov 07 15:24:23 user nova-compute[75018]: INFO nova.compute.manager [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Took 1.64 seconds to destroy the instance on the hypervisor.
Nov 07 15:24:23 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:24:23 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:24:23 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:24:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:24:24 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Took 1.33 seconds to deallocate network for instance.
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-88216eaa-8d73-4656-940a-cf5451df7031 req-77bbcf8a-611a-44ca-a507-2c8fd288a29f service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Received event network-vif-deleted-798cf71a-7966-4f68-b9ee-18e46b62c089 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:24 user nova-compute[75018]: INFO nova.compute.manager [req-88216eaa-8d73-4656-940a-cf5451df7031 req-77bbcf8a-611a-44ca-a507-2c8fd288a29f service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Neutron deleted interface 798cf71a-7966-4f68-b9ee-18e46b62c089; detaching it from the instance and deleting it from the info cache
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.network.neutron [req-88216eaa-8d73-4656-940a-cf5451df7031 req-77bbcf8a-611a-44ca-a507-2c8fd288a29f service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-88216eaa-8d73-4656-940a-cf5451df7031 req-77bbcf8a-611a-44ca-a507-2c8fd288a29f service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Detach interface failed, port_id=798cf71a-7966-4f68-b9ee-18e46b62c089, reason: Instance 22422ecc-1027-41c5-9bea-066fdc8ca995 could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-5a2e7ee9-58c4-46e3-8f31-961dfb488150 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-5a2e7ee9-58c4-46e3-8f31-961dfb488150 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:24 user nova-compute[75018]: WARNING nova.compute.manager [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-5a2e7ee9-58c4-46e3-8f31-961dfb488150 for instance with vm_state building and task_state spawning.
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-5a2e7ee9-58c4-46e3-8f31-961dfb488150 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-5a2e7ee9-58c4-46e3-8f31-961dfb488150 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:24 user nova-compute[75018]: WARNING nova.compute.manager [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-5a2e7ee9-58c4-46e3-8f31-961dfb488150 for instance with vm_state building and task_state spawning.
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:24 user nova-compute[75018]: WARNING nova.compute.manager [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 for instance with vm_state building and task_state spawning.
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:24 user nova-compute[75018]: WARNING nova.compute.manager [req-517a4c11-9a8d-4f84-80bc-036835202afc req-dbc052c5-0ff1-41b3-93bf-6051b284de65 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 for instance with vm_state building and task_state spawning.
Nov 07 15:24:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Received event network-vif-plugged-798cf71a-7966-4f68-b9ee-18e46b62c089 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Acquiring lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Lock "22422ecc-1027-41c5-9bea-066fdc8ca995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] No waiting events found dispatching network-vif-plugged-798cf71a-7966-4f68-b9ee-18e46b62c089 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:24 user nova-compute[75018]: WARNING nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 22422ecc-1027-41c5-9bea-066fdc8ca995] Received unexpected event network-vif-plugged-798cf71a-7966-4f68-b9ee-18e46b62c089 for instance with vm_state deleted and task_state None.
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-0961679c-4367-4cb0-b7f8-b763408f97c6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-0961679c-4367-4cb0-b7f8-b763408f97c6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:24 user nova-compute[75018]: WARNING nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-0961679c-4367-4cb0-b7f8-b763408f97c6 for instance with vm_state building and task_state spawning.
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-0961679c-4367-4cb0-b7f8-b763408f97c6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-0961679c-4367-4cb0-b7f8-b763408f97c6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:24 user nova-compute[75018]: WARNING nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-0961679c-4367-4cb0-b7f8-b763408f97c6 for instance with vm_state building and task_state spawning.
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-106cd061-e91b-4718-8c52-cbaf14defe8c {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-106cd061-e91b-4718-8c52-cbaf14defe8c {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:24 user nova-compute[75018]: WARNING nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-106cd061-e91b-4718-8c52-cbaf14defe8c for instance with vm_state building and task_state spawning.
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-106cd061-e91b-4718-8c52-cbaf14defe8c {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-106cd061-e91b-4718-8c52-cbaf14defe8c {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:24 user nova-compute[75018]: WARNING nova.compute.manager [req-f8be68ee-ddd1-42cb-8be5-d7b3ca58f884 req-270a8ac9-0a80-4b79-853b-f3bf4b14e5a7 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-106cd061-e91b-4718-8c52-cbaf14defe8c for instance with vm_state building and task_state spawning.
Nov 07 15:24:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:25 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:24:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:25 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:24:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.743s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:25 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Deleted allocations for instance 22422ecc-1027-41c5-9bea-066fdc8ca995
Nov 07 15:24:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0780eab-e215-4497-95ef-6a4645d05232 tempest-VolumesActionsTest-1778955523 tempest-VolumesActionsTest-1778955523-project-member] Lock "22422ecc-1027-41c5-9bea-066fdc8ca995" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.151s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:24:26 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Instance spawned successfully.
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:26 user nova-compute[75018]: INFO nova.compute.manager [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Took 15.85 seconds to spawn the instance on the hypervisor.
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:24:26 user nova-compute[75018]: INFO nova.compute.claims [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Claim successful on node user
Nov 07 15:24:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:26 user nova-compute[75018]: INFO nova.compute.manager [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Took 122.68 seconds to build instance.
Nov 07 15:24:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b2e1cea-9fd2-4366-bd7f-67ad6216c7ed tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 123.260s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdl (vdc) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:24:27 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 is timed out.
Nov 07 15:24:27 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Successfully detached device vdb from instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 from the live domain config.
Nov 07 15:24:27 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:24:27 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8049MB free_disk=25.36948013305664GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKUwLZeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:27 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[37891b16-19a4-4612-9486-b1e8072f4070]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:24:27 user nova-compute[75018]: No targets found.
Nov 07 15:24:27 user nova-compute[75018]: iSNS:
Nov 07 15:24:27 user nova-compute[75018]: No targets found.
Nov 07 15:24:27 user nova-compute[75018]: STATIC:
Nov 07 15:24:27 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3
Nov 07 15:24:27 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:27 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:27 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c
Nov 07 15:24:27 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:27 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:27 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042
Nov 07 15:24:27 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:27 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:27 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20
Nov 07 15:24:27 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:27 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:27 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1
Nov 07 15:24:27 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:27 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:27 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a
Nov 07 15:24:27 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:27 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:27 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867
Nov 07 15:24:27 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:27 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:27 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45
Nov 07 15:24:27 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:27 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:27 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:24:27 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:27 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:27 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f
Nov 07 15:24:27 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:27 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:27 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6
Nov 07 15:24:27 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:27 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:27 user nova-compute[75018]: FIRMWARE:
Nov 07 15:24:27 user nova-compute[75018]: No targets found.
Nov 07 15:24:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:24:27 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:24:27 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f9a558-6449-4dc3-a82c-8de19cdaf1ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.334s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.093s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffab1a92-d9fe-438c-8911-e36c3a17dccb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb001a7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45'): ({'sdc'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Removing single pathed devices sdc {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3fd6e7-c956-4ccf-b69f-88297011544d]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:27 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:24:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1f7f81-ab0d-4ac0-b401-b3aade86edc4]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Flushing IO for device /dev/sdc {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f524b5-29ab-45e0-a752-13a0ec699ebd]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8257c590-204a-4fde-8487-79b8c0c87ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 569b9815-efc4-46d0-832e-9931fdd7d6ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e3abd70e-baf7-4f13-832c-43696a5ea80c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance d5341681-9ba6-4f21-a67c-00d50aea8762 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 5212605c-c913-483f-874b-17af335aeb2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 934e9b7f-8bb4-4487-83cd-c5fbc92daefc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:24:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 44f8bf0d-9714-45cf-8f71-206a8bb75a3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[86647028-141a-4993-8bc6-11e2f64db429]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.policy [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14513d0fd65548438fa3d8566ef13d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ee8e1771f54c2487c53dc92ed64f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance eb712362-b6b8-4a19-8f5b-8c374d6c4d87 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fd4678-e545-41b9-8776-8c9055fe432b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:24:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Creating image(s)
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "/opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "/opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "/opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cfd905-01c3-4519-8773-8ef2136b44ee]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45, portal: 172.16.0.220,3260]
Nov 07 15:24:28 user nova-compute[75018]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45, portal: 172.16.0.220,3260] successful.
Nov 07 15:24:28 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b is timed out.
Nov 07 15:24:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Successfully detached device vdb from instance 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b from the live domain config.
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f72a29-56f8-4f29-a0fe-a4e7845f5d45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.136s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3427fc58-db94-48f7-a2af-97ce9adb8c17]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.608s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] <== disconnect_volume: return (610ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YkmSGHeq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:28 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.208s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[668a0a94-f112-4629-b456-797f0ba46f85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:24:28 user nova-compute[75018]: No targets found.
Nov 07 15:24:28 user nova-compute[75018]: iSNS:
Nov 07 15:24:28 user nova-compute[75018]: No targets found.
Nov 07 15:24:28 user nova-compute[75018]: STATIC:
Nov 07 15:24:28 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3
Nov 07 15:24:28 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:28 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:28 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c
Nov 07 15:24:28 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:28 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:28 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042
Nov 07 15:24:28 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:28 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:28 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20
Nov 07 15:24:28 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:28 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:28 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1
Nov 07 15:24:28 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:28 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:28 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a
Nov 07 15:24:28 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:28 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:28 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867
Nov 07 15:24:28 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:28 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:28 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:24:28 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:28 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:28 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f
Nov 07 15:24:28 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:28 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:28 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6
Nov 07 15:24:28 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:28 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:28 user nova-compute[75018]: FIRMWARE:
Nov 07 15:24:28 user nova-compute[75018]: No targets found.
Nov 07 15:24:28 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:24:28 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:24:28 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b47361-5594-4322-8582-d6e64659f9dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8c61fd-266f-43b3-a052-272fe5920361]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:28 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:28 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:28 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb001f9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20'): ({'sdd'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Removing single pathed devices sdd {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3923b85-5864-4fd3-a37d-a587062cef42]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2167a16a-fb88-4002-a1bf-2889de915ea6]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Flushing IO for device /dev/sdd {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk 1073741824" returned: 0 in 0.056s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f513a0a1-f9d5-4cc5-a62a-05d1627fd5ea]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f9799b-1c30-4b32-bc8a-952adb11a452]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[552a5e9c-f5a7-4723-8a9e-4a0f85d1d0a5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.234s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d21634-5f8b-46ee-899e-bb1b6580ca7a]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.086s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20, portal: 172.16.0.220,3260]
Nov 07 15:24:28 user nova-compute[75018]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20, portal: 172.16.0.220,3260] successful.
Nov 07 15:24:28 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Successfully created port: 97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fad71d3b-1467-4189-bb87-db6051b3bc20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1578127b-e930-4451-9e54-74978d4f7123]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.609s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] <== disconnect_volume: return (610ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Cannot resize image /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Ensure instance console log exists: /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Successfully updated port: 97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquired lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG nova.compute.manager [req-4c08dfbd-0577-4395-a178-d4892ced2465 req-a883fa30-e69c-4fd8-be83-756aa7a2470d service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-changed-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG nova.compute.manager [req-4c08dfbd-0577-4395-a178-d4892ced2465 req-a883fa30-e69c-4fd8-be83-756aa7a2470d service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Refreshing instance network info cache due to event network-changed-97ce6c8c-ae6c-444d-a746-0c41c90dad44. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4c08dfbd-0577-4395-a178-d4892ced2465 req-a883fa30-e69c-4fd8-be83-756aa7a2470d service nova] Acquiring lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG nova.objects.instance [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lazy-loading 'flavor' on Instance uuid f9efb536-b47e-4e87-bc54-fdf69cacf8e3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:24:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dc830595-9d58-40cc-9607-d2dbc2c7006e tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.451s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updating instance_info_cache with network_info: [{"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Releasing lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Instance network_info: |[{"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4c08dfbd-0577-4395-a178-d4892ced2465 req-a883fa30-e69c-4fd8-be83-756aa7a2470d service nova] Acquired lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.network.neutron [req-4c08dfbd-0577-4395-a178-d4892ced2465 req-a883fa30-e69c-4fd8-be83-756aa7a2470d service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Refreshing network info cache for port 97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Start _get_guest_xml network_info=[{"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "interface-f9efb536-b47e-4e87-bc54-fdf69cacf8e3-59996421-4eca-48d7-a613-1e938d23fc17" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "interface-f9efb536-b47e-4e87-bc54-fdf69cacf8e3-59996421-4eca-48d7-a613-1e938d23fc17" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:30 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:24:30 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.objects.instance [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lazy-loading 'flavor' on Instance uuid f9efb536-b47e-4e87-bc54-fdf69cacf8e3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1060099405',display_name='tempest-ServerStableDeviceRescueTest-server-1060099405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1060099405',id=13,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsh3m/AqvutcaB/9qpzjup0szhTy9U7TET9KerVY4YFJ3We6+i+pyTqY/LNekdndGfNoBNA07ivKONj4Ow+ANxrGLLW8+Jt5PgTGpfXG/eJIu8EEpT7vH1p59af4bkJ7w==',key_name='tempest-keypair-1769152991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02ee8e1771f54c2487c53dc92ed64f84',ramdisk_id='',reservation_id='r-0fhpeenx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1105529090',owner_user_name='tempest-ServerStableDeviceRescueTest-1105529090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:24:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14513d0fd65548438fa3d8566ef13d0b',uuid=4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Converting VIF {"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ca:d8,bridge_name='br-int',has_traffic_filtering=True,id=97ce6c8c-ae6c-444d-a746-0c41c90dad44,network=Network(ff9ceebb-2e39-4b05-8df4-ec60615d958d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ce6c8c-ae') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.objects.instance [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-569b9815-efc4-46d0-832e-9931fdd7d6ad" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-569b9815-efc4-46d0-832e-9931fdd7d6ad" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1580286647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1580286647',id=6,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBa2umF2j3NFcrA/MMVfFX9CwszOvYSV953cPLJB8Fg9xF6mpuVYI1nrRM/8pACoITM+FQT+M6FG3/0v9UsQ2UUg5VLULbr4xVkSLj0F171iDoJzrj+ppTAogqlmzzug==',key_name='tempest-keypair-464082042',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:21:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c9868af5b9d4666b842470b30e169d2',ramdisk_id='',reservation_id='r-tw13f7f8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2013364869',owner_user_name='tempest-TaggedAttachmentsTest-2013364869-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:21:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd118649a4241bb95956240a2393048',uuid=f9efb536-b47e-4e87-bc54-fdf69cacf8e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59996421-4eca-48d7-a613-1e938d23fc17", "address": "fa:16:3e:b8:5e:1e", "network": {"id": "8b16abf0-67a0-46d6-b688-5059b2dd37e9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1556414992", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59996421-4e", "ovs_interfaceid": "59996421-4eca-48d7-a613-1e938d23fc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Converting VIF {"id": "59996421-4eca-48d7-a613-1e938d23fc17", "address": "fa:16:3e:b8:5e:1e", "network": {"id": "8b16abf0-67a0-46d6-b688-5059b2dd37e9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1556414992", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59996421-4e", "ovs_interfaceid": "59996421-4eca-48d7-a613-1e938d23fc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:1e,bridge_name='br-int',has_traffic_filtering=True,id=59996421-4eca-48d7-a613-1e938d23fc17,network=Network(8b16abf0-67a0-46d6-b688-5059b2dd37e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59996421-4e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:24:30 user nova-compute[75018]:   <uuid>4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e</uuid>
Nov 07 15:24:30 user nova-compute[75018]:   <name>instance-0000000d</name>
Nov 07 15:24:30 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:24:30 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:24:30 user nova-compute[75018]:   <metadata>
Nov 07 15:24:30 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:24:30 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:24:30 user nova-compute[75018]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1060099405</nova:name>
Nov 07 15:24:30 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:24:30</nova:creationTime>
Nov 07 15:24:30 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:24:30 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:24:30 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:24:30 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:24:30 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:24:30 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:24:30 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:24:30 user nova-compute[75018]:       <nova:owner>
Nov 07 15:24:30 user nova-compute[75018]:         <nova:user uuid="14513d0fd65548438fa3d8566ef13d0b">tempest-ServerStableDeviceRescueTest-1105529090-project-member</nova:user>
Nov 07 15:24:30 user nova-compute[75018]:         <nova:project uuid="02ee8e1771f54c2487c53dc92ed64f84">tempest-ServerStableDeviceRescueTest-1105529090</nova:project>
Nov 07 15:24:30 user nova-compute[75018]:       </nova:owner>
Nov 07 15:24:30 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:24:30 user nova-compute[75018]:       <nova:ports>
Nov 07 15:24:30 user nova-compute[75018]:         <nova:port uuid="97ce6c8c-ae6c-444d-a746-0c41c90dad44">
Nov 07 15:24:30 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 15:24:30 user nova-compute[75018]:         </nova:port>
Nov 07 15:24:30 user nova-compute[75018]:       </nova:ports>
Nov 07 15:24:30 user nova-compute[75018]:     </nova:instance>
Nov 07 15:24:30 user nova-compute[75018]:   </metadata>
Nov 07 15:24:30 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:24:30 user nova-compute[75018]:     <system>
Nov 07 15:24:30 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:24:30 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:24:30 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:24:30 user nova-compute[75018]:       <entry name="serial">4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e</entry>
Nov 07 15:24:30 user nova-compute[75018]:       <entry name="uuid">4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e</entry>
Nov 07 15:24:30 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:24:30 user nova-compute[75018]:     </system>
Nov 07 15:24:30 user nova-compute[75018]:   </sysinfo>
Nov 07 15:24:30 user nova-compute[75018]:   <os>
Nov 07 15:24:30 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:24:30 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:24:30 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:24:30 user nova-compute[75018]:   </os>
Nov 07 15:24:30 user nova-compute[75018]:   <features>
Nov 07 15:24:30 user nova-compute[75018]:     <acpi/>
Nov 07 15:24:30 user nova-compute[75018]:     <apic/>
Nov 07 15:24:30 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:24:30 user nova-compute[75018]:   </features>
Nov 07 15:24:30 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:24:30 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:24:30 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:24:30 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:24:30 user nova-compute[75018]:   </clock>
Nov 07 15:24:30 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:24:30 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:24:30 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:24:30 user nova-compute[75018]:   </cpu>
Nov 07 15:24:30 user nova-compute[75018]:   <devices>
Nov 07 15:24:30 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:24:30 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:24:30 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk"/>
Nov 07 15:24:30 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:24:30 user nova-compute[75018]:     </disk>
Nov 07 15:24:30 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:24:30 user nova-compute[75018]:       <mac address="fa:16:3e:fd:ca:d8"/>
Nov 07 15:24:30 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:30 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:24:30 user nova-compute[75018]:       <target dev="tap97ce6c8c-ae"/>
Nov 07 15:24:30 user nova-compute[75018]:     </interface>
Nov 07 15:24:30 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:24:30 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/console.log" append="off"/>
Nov 07 15:24:30 user nova-compute[75018]:     </serial>
Nov 07 15:24:30 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:24:30 user nova-compute[75018]:     <video>
Nov 07 15:24:30 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:24:30 user nova-compute[75018]:     </video>
Nov 07 15:24:30 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:24:30 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:24:30 user nova-compute[75018]:     </rng>
Nov 07 15:24:30 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:24:30 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:24:30 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:24:30 user nova-compute[75018]:     </memballoon>
Nov 07 15:24:30 user nova-compute[75018]:   </devices>
Nov 07 15:24:30 user nova-compute[75018]: </domain>
Nov 07 15:24:30 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1060099405',display_name='tempest-ServerStableDeviceRescueTest-server-1060099405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1060099405',id=13,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsh3m/AqvutcaB/9qpzjup0szhTy9U7TET9KerVY4YFJ3We6+i+pyTqY/LNekdndGfNoBNA07ivKONj4Ow+ANxrGLLW8+Jt5PgTGpfXG/eJIu8EEpT7vH1p59af4bkJ7w==',key_name='tempest-keypair-1769152991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02ee8e1771f54c2487c53dc92ed64f84',ramdisk_id='',reservation_id='r-0fhpeenx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1105529090',owner_user_name='tempest-ServerStableDeviceRescueTest-1105529090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:24:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14513d0fd65548438fa3d8566ef13d0b',uuid=4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Converting VIF {"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ca:d8,bridge_name='br-int',has_traffic_filtering=True,id=97ce6c8c-ae6c-444d-a746-0c41c90dad44,network=Network(ff9ceebb-2e39-4b05-8df4-ec60615d958d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ce6c8c-ae') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG os_vif [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ca:d8,bridge_name='br-int',has_traffic_filtering=True,id=97ce6c8c-ae6c-444d-a746-0c41c90dad44,network=Network(ff9ceebb-2e39-4b05-8df4-ec60615d958d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ce6c8c-ae') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0866e25-e1d7-5aab-8831-25cbc5ab5a47', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b8:5e:1e"/><model type="virtio"/><mtu size="1442"/><target dev="tap59996421-4e"/></interface> {{(pid=75018) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97ce6c8c-ae, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97ce6c8c-ae, col_values=(('qos', UUID('95ccedf3-c0f9-4da3-aea5-26026c99508d')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97ce6c8c-ae, col_values=(('external_ids', {'iface-id': '97ce6c8c-ae6c-444d-a746-0c41c90dad44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:ca:d8', 'vm-uuid': '4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b8:5e:1e"/><model type="virtio"/><mtu size="1442"/><target dev="tap59996421-4e"/></interface> {{(pid=75018) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Attempting to detach device tap59996421-4e from instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] detach device xml: <interface type="ethernet">
Nov 07 15:24:30 user nova-compute[75018]:   <mac address="fa:16:3e:b8:5e:1e"/>
Nov 07 15:24:30 user nova-compute[75018]:   <model type="virtio"/>
Nov 07 15:24:30 user nova-compute[75018]:   <mtu size="1442"/>
Nov 07 15:24:30 user nova-compute[75018]:   <target dev="tap59996421-4e"/>
Nov 07 15:24:30 user nova-compute[75018]: </interface>
Nov 07 15:24:30 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b8:5e:1e"/><model type="virtio"/><mtu size="1442"/><target dev="tap59996421-4e"/></interface> {{(pid=75018) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:30 user nova-compute[75018]: INFO os_vif [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ca:d8,bridge_name='br-int',has_traffic_filtering=True,id=97ce6c8c-ae6c-444d-a746-0c41c90dad44,network=Network(ff9ceebb-2e39-4b05-8df4-ec60615d958d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ce6c8c-ae')
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b8:5e:1e"/><model type="virtio"/><mtu size="1442"/><target dev="tap59996421-4e"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 07 15:24:30 user nova-compute[75018]:   <name>instance-00000006</name>
Nov 07 15:24:30 user nova-compute[75018]:   <uuid>f9efb536-b47e-4e87-bc54-fdf69cacf8e3</uuid>
Nov 07 15:24:30 user nova-compute[75018]:   <metadata>
Nov 07 15:24:30 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:24:30 user nova-compute[75018]:   <nova:package version="0.0.0"/>
Nov 07 15:24:30 user nova-compute[75018]:   <nova:name>tempest-device-tagging-server-1580286647</nova:name>
Nov 07 15:24:30 user nova-compute[75018]:   <nova:creationTime>2023-11-07 15:22:53</nova:creationTime>
Nov 07 15:24:30 user nova-compute[75018]:   <nova:flavor name="m1.tiny">
Nov 07 15:24:30 user nova-compute[75018]:     <nova:memory>512</nova:memory>
Nov 07 15:24:30 user nova-compute[75018]:     <nova:disk>1</nova:disk>
Nov 07 15:24:30 user nova-compute[75018]:     <nova:swap>0</nova:swap>
Nov 07 15:24:30 user nova-compute[75018]:     <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:24:30 user nova-compute[75018]:     <nova:vcpus>1</nova:vcpus>
Nov 07 15:24:30 user nova-compute[75018]:   </nova:flavor>
Nov 07 15:24:30 user nova-compute[75018]:   <nova:owner>
Nov 07 15:24:30 user nova-compute[75018]:     <nova:user uuid="8dd118649a4241bb95956240a2393048">tempest-TaggedAttachmentsTest-2013364869-project-member</nova:user>
Nov 07 15:24:30 user nova-compute[75018]:     <nova:project uuid="5c9868af5b9d4666b842470b30e169d2">tempest-TaggedAttachmentsTest-2013364869</nova:project>
Nov 07 15:24:30 user nova-compute[75018]:   </nova:owner>
Nov 07 15:24:30 user nova-compute[75018]:   <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:24:30 user nova-compute[75018]:   <nova:ports>
Nov 07 15:24:30 user nova-compute[75018]:     <nova:port uuid="5b3da5d6-6cee-4668-b7cd-5d328309eca6">
Nov 07 15:24:30 user nova-compute[75018]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 07 15:24:30 user nova-compute[75018]:     </nova:port>
Nov 07 15:24:30 user nova-compute[75018]:     <nova:port uuid="59996421-4eca-48d7-a613-1e938d23fc17">
Nov 07 15:24:30 user nova-compute[75018]:       <nova:ip type="fixed" address="10.10.10.97" ipVersion="4"/>
Nov 07 15:24:30 user nova-compute[75018]:     </nova:port>
Nov 07 15:24:30 user nova-compute[75018]:   </nova:ports>
Nov 07 15:24:30 user nova-compute[75018]: </nova:instance>
Nov 07 15:24:30 user nova-compute[75018]:   </metadata>
Nov 07 15:24:30 user nova-compute[75018]:   <memory unit='KiB'>524288</memory>
Nov 07 15:24:30 user nova-compute[75018]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 07 15:24:30 user nova-compute[75018]:   <vcpu placement='static'>1</vcpu>
Nov 07 15:24:30 user nova-compute[75018]:   <resource>
Nov 07 15:24:30 user nova-compute[75018]:     <partition>/machine</partition>
Nov 07 15:24:30 user nova-compute[75018]:   </resource>
Nov 07 15:24:30 user nova-compute[75018]:   <sysinfo type='smbios'>
Nov 07 15:24:30 user nova-compute[75018]:     <system>
Nov 07 15:24:30 user nova-compute[75018]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 07 15:24:30 user nova-compute[75018]:       <entry name='product'>OpenStack Nova</entry>
Nov 07 15:24:30 user nova-compute[75018]:       <entry name='version'>0.0.0</entry>
Nov 07 15:24:30 user nova-compute[75018]:       <entry name='serial'>f9efb536-b47e-4e87-bc54-fdf69cacf8e3</entry>
Nov 07 15:24:30 user nova-compute[75018]:       <entry name='uuid'>f9efb536-b47e-4e87-bc54-fdf69cacf8e3</entry>
Nov 07 15:24:30 user nova-compute[75018]:       <entry name='family'>Virtual Machine</entry>
Nov 07 15:24:30 user nova-compute[75018]:     </system>
Nov 07 15:24:30 user nova-compute[75018]:   </sysinfo>
Nov 07 15:24:30 user nova-compute[75018]:   <os>
Nov 07 15:24:30 user nova-compute[75018]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 07 15:24:30 user nova-compute[75018]:     <boot dev='hd'/>
Nov 07 15:24:30 user nova-compute[75018]:     <smbios mode='sysinfo'/>
Nov 07 15:24:30 user nova-compute[75018]:   </os>
Nov 07 15:24:30 user nova-compute[75018]:   <features>
Nov 07 15:24:30 user nova-compute[75018]:     <acpi/>
Nov 07 15:24:30 user nova-compute[75018]:     <apic/>
Nov 07 15:24:30 user nova-compute[75018]:     <vmcoreinfo state='on'/>
Nov 07 15:24:30 user nova-compute[75018]:   </features>
Nov 07 15:24:30 user nova-compute[75018]:   <cpu mode='custom' match='exact' check='full'>
Nov 07 15:24:30 user nova-compute[75018]:     <model fallback='forbid'>Nehalem</model>
Nov 07 15:24:30 user nova-compute[75018]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 07 15:24:30 user nova-compute[75018]:     <feature policy='require' name='vme'/>
Nov 07 15:24:30 user nova-compute[75018]:     <feature policy='require' name='x2apic'/>
Nov 07 15:24:30 user nova-compute[75018]:     <feature policy='require' name='hypervisor'/>
Nov 07 15:24:30 user nova-compute[75018]:   </cpu>
Nov 07 15:24:30 user nova-compute[75018]:   <clock offset='utc'>
Nov 07 15:24:30 user nova-compute[75018]:     <timer name='pit' tickpolicy='delay'/>
Nov 07 15:24:30 user nova-compute[75018]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 07 15:24:30 user nova-compute[75018]:     <timer name='hpet' present='no'/>
Nov 07 15:24:30 user nova-compute[75018]:   </clock>
Nov 07 15:24:30 user nova-compute[75018]:   <on_poweroff>destroy</on_poweroff>
Nov 07 15:24:30 user nova-compute[75018]:   <on_reboot>restart</on_reboot>
Nov 07 15:24:30 user nova-compute[75018]:   <on_crash>destroy</on_crash>
Nov 07 15:24:30 user nova-compute[75018]:   <devices>
Nov 07 15:24:30 user nova-compute[75018]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 07 15:24:30 user nova-compute[75018]:     <disk type='file' device='disk'>
Nov 07 15:24:30 user nova-compute[75018]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 07 15:24:30 user nova-compute[75018]:       <source file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk' index='2'/>
Nov 07 15:24:30 user nova-compute[75018]:       <backingStore type='file' index='3'>
Nov 07 15:24:30 user nova-compute[75018]:         <format type='raw'/>
Nov 07 15:24:30 user nova-compute[75018]:         <source file='/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e'/>
Nov 07 15:24:30 user nova-compute[75018]:         <backingStore/>
Nov 07 15:24:30 user nova-compute[75018]:       </backingStore>
Nov 07 15:24:30 user nova-compute[75018]:       <target dev='vda' bus='virtio'/>
Nov 07 15:24:30 user nova-compute[75018]:       <alias name='virtio-disk0'/>
Nov 07 15:24:30 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 07 15:24:30 user nova-compute[75018]:     </disk>
Nov 07 15:24:30 user nova-compute[75018]:     <disk type='file' device='cdrom'>
Nov 07 15:24:30 user nova-compute[75018]:       <driver name='qemu' type='raw' cache='none'/>
Nov 07 15:24:30 user nova-compute[75018]:       <source file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk.config' index='1'/>
Nov 07 15:24:30 user nova-compute[75018]:       <backingStore/>
Nov 07 15:24:30 user nova-compute[75018]:       <target dev='hda' bus='ide'/>
Nov 07 15:24:30 user nova-compute[75018]:       <readonly/>
Nov 07 15:24:30 user nova-compute[75018]:       <alias name='ide0-0-0'/>
Nov 07 15:24:30 user nova-compute[75018]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 07 15:24:30 user nova-compute[75018]:     </disk>
Nov 07 15:24:30 user nova-compute[75018]:     <controller type='usb' index='0' model='none'>
Nov 07 15:24:30 user nova-compute[75018]:       <alias name='usb'/>
Nov 07 15:24:30 user nova-compute[75018]:     </controller>
Nov 07 15:24:30 user nova-compute[75018]:     <controller type='pci' index='0' model='pci-root'>
Nov 07 15:24:30 user nova-compute[75018]:       <alias name='pci.0'/>
Nov 07 15:24:30 user nova-compute[75018]:     </controller>
Nov 07 15:24:30 user nova-compute[75018]:     <controller type='ide' index='0'>
Nov 07 15:24:30 user nova-compute[75018]:       <alias name='ide'/>
Nov 07 15:24:30 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 07 15:24:30 user nova-compute[75018]:     </controller>
Nov 07 15:24:30 user nova-compute[75018]:     <interface type='ethernet'>
Nov 07 15:24:30 user nova-compute[75018]:       <mac address='fa:16:3e:e1:55:2d'/>
Nov 07 15:24:30 user nova-compute[75018]:       <target dev='tap5b3da5d6-6c'/>
Nov 07 15:24:30 user nova-compute[75018]:       <model type='virtio'/>
Nov 07 15:24:30 user nova-compute[75018]:       <mtu size='1442'/>
Nov 07 15:24:30 user nova-compute[75018]:       <alias name='net0'/>
Nov 07 15:24:30 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 07 15:24:30 user nova-compute[75018]:     </interface>
Nov 07 15:24:30 user nova-compute[75018]:     <interface type='ethernet'>
Nov 07 15:24:30 user nova-compute[75018]:       <mac address='fa:16:3e:b8:5e:1e'/>
Nov 07 15:24:30 user nova-compute[75018]:       <target dev='tap59996421-4e'/>
Nov 07 15:24:30 user nova-compute[75018]:       <model type='virtio'/>
Nov 07 15:24:30 user nova-compute[75018]:       <mtu size='1442'/>
Nov 07 15:24:30 user nova-compute[75018]:       <alias name='net1'/>
Nov 07 15:24:30 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 07 15:24:30 user nova-compute[75018]:     </interface>
Nov 07 15:24:30 user nova-compute[75018]:     <serial type='pty'>
Nov 07 15:24:30 user nova-compute[75018]:       <source path='/dev/pts/5'/>
Nov 07 15:24:30 user nova-compute[75018]:       <log file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/console.log' append='off'/>
Nov 07 15:24:30 user nova-compute[75018]:       <target type='isa-serial' port='0'>
Nov 07 15:24:30 user nova-compute[75018]:         <model name='isa-serial'/>
Nov 07 15:24:30 user nova-compute[75018]:       </target>
Nov 07 15:24:30 user nova-compute[75018]:       <alias name='serial0'/>
Nov 07 15:24:30 user nova-compute[75018]:     </serial>
Nov 07 15:24:30 user nova-compute[75018]:     <console type='pty' tty='/dev/pts/5'>
Nov 07 15:24:30 user nova-compute[75018]:       <source path='/dev/pts/5'/>
Nov 07 15:24:30 user nova-compute[75018]:       <log file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/console.log' append='off'/>
Nov 07 15:24:30 user nova-compute[75018]:       <target type='serial' port='0'/>
Nov 07 15:24:30 user nova-compute[75018]:       <alias name='serial0'/>
Nov 07 15:24:30 user nova-compute[75018]:     </console>
Nov 07 15:24:30 user nova-compute[75018]:     <input type='mouse' bus='ps2'>
Nov 07 15:24:30 user nova-compute[75018]:       <alias name='input0'/>
Nov 07 15:24:30 user nova-compute[75018]:     </input>
Nov 07 15:24:30 user nova-compute[75018]:     <input type='keyboard' bus='ps2'>
Nov 07 15:24:30 user nova-compute[75018]:       <alias name='input1'/>
Nov 07 15:24:30 user nova-compute[75018]:     </input>
Nov 07 15:24:30 user nova-compute[75018]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 07 15:24:30 user nova-compute[75018]:       <listen type='address' address='0.0.0.0'/>
Nov 07 15:24:30 user nova-compute[75018]:     </graphics>
Nov 07 15:24:30 user nova-compute[75018]:     <audio id='1' type='none'/>
Nov 07 15:24:30 user nova-compute[75018]:     <video>
Nov 07 15:24:30 user nova-compute[75018]:       <model type='virtio' heads='1' primary='yes'/>
Nov 07 15:24:30 user nova-compute[75018]:       <alias name='video0'/>
Nov 07 15:24:30 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 07 15:24:30 user nova-compute[75018]:     </video>
Nov 07 15:24:30 user nova-compute[75018]:     <memballoon model='virtio'>
Nov 07 15:24:30 user nova-compute[75018]:       <stats period='10'/>
Nov 07 15:24:30 user nova-compute[75018]:       <alias name='balloon0'/>
Nov 07 15:24:30 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 07 15:24:30 user nova-compute[75018]:     </memballoon>
Nov 07 15:24:30 user nova-compute[75018]:     <rng model='virtio'>
Nov 07 15:24:30 user nova-compute[75018]:       <backend model='random'>/dev/urandom</backend>
Nov 07 15:24:30 user nova-compute[75018]:       <alias name='rng0'/>
Nov 07 15:24:30 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 07 15:24:30 user nova-compute[75018]:     </rng>
Nov 07 15:24:30 user nova-compute[75018]:   </devices>
Nov 07 15:24:30 user nova-compute[75018]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 07 15:24:30 user nova-compute[75018]:     <label>libvirt-f9efb536-b47e-4e87-bc54-fdf69cacf8e3</label>
Nov 07 15:24:30 user nova-compute[75018]:     <imagelabel>libvirt-f9efb536-b47e-4e87-bc54-fdf69cacf8e3</imagelabel>
Nov 07 15:24:30 user nova-compute[75018]:   </seclabel>
Nov 07 15:24:30 user nova-compute[75018]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 07 15:24:30 user nova-compute[75018]:     <label>+64055:+108</label>
Nov 07 15:24:30 user nova-compute[75018]:     <imagelabel>+64055:+108</imagelabel>
Nov 07 15:24:30 user nova-compute[75018]:   </seclabel>
Nov 07 15:24:30 user nova-compute[75018]: </domain>
Nov 07 15:24:30 user nova-compute[75018]:  {{(pid=75018) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 07 15:24:30 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Successfully detached device tap59996421-4e from instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 from the persistent domain config.
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] (1/8): Attempting to detach device tap59996421-4e with device alias net1 from instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] detach device xml: <interface type="ethernet">
Nov 07 15:24:30 user nova-compute[75018]:   <mac address="fa:16:3e:b8:5e:1e"/>
Nov 07 15:24:30 user nova-compute[75018]:   <model type="virtio"/>
Nov 07 15:24:30 user nova-compute[75018]:   <mtu size="1442"/>
Nov 07 15:24:30 user nova-compute[75018]:   <target dev="tap59996421-4e"/>
Nov 07 15:24:30 user nova-compute[75018]: </interface>
Nov 07 15:24:30 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] No VIF found with MAC fa:16:3e:fd:ca:d8, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.network.neutron [req-4c08dfbd-0577-4395-a178-d4892ced2465 req-a883fa30-e69c-4fd8-be83-756aa7a2470d service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updated VIF entry in instance network info cache for port 97ce6c8c-ae6c-444d-a746-0c41c90dad44. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.network.neutron [req-4c08dfbd-0577-4395-a178-d4892ced2465 req-a883fa30-e69c-4fd8-be83-756aa7a2470d service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updating instance_info_cache with network_info: [{"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Start waiting for the detach event from libvirt for device tap59996421-4e with device alias net1 for instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4c08dfbd-0577-4395-a178-d4892ced2465 req-a883fa30-e69c-4fd8-be83-756aa7a2470d service nova] Releasing lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Updating instance_info_cache with network_info: [{"id": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "address": "fa:16:3e:76:54:9c", "network": {"id": "4f26fb82-d023-4342-9035-8726850c06ad", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-819357445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "878175ee02584bcbb6f34320413d5a81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7ff3f5-f2", "ovs_interfaceid": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-569b9815-efc4-46d0-832e-9931fdd7d6ad" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-ef9812a1-ee92-40ce-90ca-e5f1ba2d9dc9 req-3e1c3f79-c6c1-4a77-a72c-3827abcf6b0a service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received event network-vif-unplugged-59996421-4eca-48d7-a613-1e938d23fc17 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ef9812a1-ee92-40ce-90ca-e5f1ba2d9dc9 req-3e1c3f79-c6c1-4a77-a72c-3827abcf6b0a service nova] Acquiring lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ef9812a1-ee92-40ce-90ca-e5f1ba2d9dc9 req-3e1c3f79-c6c1-4a77-a72c-3827abcf6b0a service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ef9812a1-ee92-40ce-90ca-e5f1ba2d9dc9 req-3e1c3f79-c6c1-4a77-a72c-3827abcf6b0a service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-ef9812a1-ee92-40ce-90ca-e5f1ba2d9dc9 req-3e1c3f79-c6c1-4a77-a72c-3827abcf6b0a service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] No waiting events found dispatching network-vif-unplugged-59996421-4eca-48d7-a613-1e938d23fc17 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:30 user nova-compute[75018]: WARNING nova.compute.manager [req-ef9812a1-ee92-40ce-90ca-e5f1ba2d9dc9 req-3e1c3f79-c6c1-4a77-a72c-3827abcf6b0a service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received unexpected event network-vif-unplugged-59996421-4eca-48d7-a613-1e938d23fc17 for instance with vm_state active and task_state None.
Nov 07 15:24:31 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 569b9815-efc4-46d0-832e-9931fdd7d6ad is timed out.
Nov 07 15:24:31 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Successfully detached device sdc from instance 569b9815-efc4-46d0-832e-9931fdd7d6ad from the live domain config.
Nov 07 15:24:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFeCpyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:31 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb163a9-e410-41c3-a6d0-452fa7215f2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:24:31 user nova-compute[75018]: No targets found.
Nov 07 15:24:31 user nova-compute[75018]: iSNS:
Nov 07 15:24:31 user nova-compute[75018]: No targets found.
Nov 07 15:24:31 user nova-compute[75018]: STATIC:
Nov 07 15:24:31 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3
Nov 07 15:24:31 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:31 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:31 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c
Nov 07 15:24:31 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:31 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:31 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042
Nov 07 15:24:31 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:31 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:31 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1
Nov 07 15:24:31 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:31 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:31 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a
Nov 07 15:24:31 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:31 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:31 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867
Nov 07 15:24:31 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:31 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:31 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:24:31 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:31 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:31 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f
Nov 07 15:24:31 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:31 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:31 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6
Nov 07 15:24:31 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:31 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:31 user nova-compute[75018]: FIRMWARE:
Nov 07 15:24:31 user nova-compute[75018]: No targets found.
Nov 07 15:24:31 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:24:31 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:24:31 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[070a4fe6-5ff5-45f6-81c4-a33bc4183b68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lazy-loading 'flavor' on Instance uuid 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[df38592c-44a8-48d1-a37b-4671fe6bcf81]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:31 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:31 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:31 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae06aaf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f'): ({'sde'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Removing single pathed devices sde {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c0724f-49f5-4f98-ad66-fd1552b3acca]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4491229-8b96-4e23-81f0-fffc2f409474 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.674s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb5fae9-e2db-417f-9573-3d6c6d01ca42]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Flushing IO for device /dev/sde {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12854d6-a6b7-4fd0-a9da-d0afbaaaf2b0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.065s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0fa545-69ef-4c1d-808d-a5b15b481d3a]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] SCSI volumes sde have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59f9e45-0ac4-4fc2-b8f0-e71ff46f9fb5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a93ff4-a23d-40e8-af5c-dc100d512d95]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f, portal: 172.16.0.220,3260]
Nov 07 15:24:31 user nova-compute[75018]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f, portal: 172.16.0.220,3260] successful.
Nov 07 15:24:31 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ef90d02-43f0-4323-900b-d570ffdebb3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c14b21-4e47-4f2d-85c6-84f805509f75]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.488s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] <== disconnect_volume: return (489ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:24:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received event network-vif-plugged-59996421-4eca-48d7-a613-1e938d23fc17 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] Acquiring lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] No waiting events found dispatching network-vif-plugged-59996421-4eca-48d7-a613-1e938d23fc17 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:33 user nova-compute[75018]: WARNING nova.compute.manager [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received unexpected event network-vif-plugged-59996421-4eca-48d7-a613-1e938d23fc17 for instance with vm_state active and task_state None.
Nov 07 15:24:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] No waiting events found dispatching network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:33 user nova-compute[75018]: WARNING nova.compute.manager [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received unexpected event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 for instance with vm_state building and task_state spawning.
Nov 07 15:24:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] No waiting events found dispatching network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:33 user nova-compute[75018]: WARNING nova.compute.manager [req-9b255fa3-8c6f-44b7-831b-7acf4fb6ab7d req-c2ea9f8f-224c-4e46-99c7-1db43ff4ff1a service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received unexpected event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 for instance with vm_state building and task_state spawning.
Nov 07 15:24:33 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lazy-loading 'flavor' on Instance uuid 569b9815-efc4-46d0-832e-9931fdd7d6ad {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a4e57105-a256-42d7-bf66-ba1c5c4fe8ec tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.258s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:33 user nova-compute[75018]: INFO nova.compute.manager [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Terminating instance
Nov 07 15:24:33 user nova-compute[75018]: DEBUG nova.compute.manager [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-550f8a72-3d12-45df-87af-50775669cb88 req-e8dcf66e-cac2-4274-b950-74e6b6ee89d8 service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Received event network-vif-unplugged-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-550f8a72-3d12-45df-87af-50775669cb88 req-e8dcf66e-cac2-4274-b950-74e6b6ee89d8 service nova] Acquiring lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-550f8a72-3d12-45df-87af-50775669cb88 req-e8dcf66e-cac2-4274-b950-74e6b6ee89d8 service nova] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-550f8a72-3d12-45df-87af-50775669cb88 req-e8dcf66e-cac2-4274-b950-74e6b6ee89d8 service nova] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-550f8a72-3d12-45df-87af-50775669cb88 req-e8dcf66e-cac2-4274-b950-74e6b6ee89d8 service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] No waiting events found dispatching network-vif-unplugged-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-550f8a72-3d12-45df-87af-50775669cb88 req-e8dcf66e-cac2-4274-b950-74e6b6ee89d8 service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Received event network-vif-unplugged-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:24:34 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Instance destroyed successfully.
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.objects.instance [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lazy-loading 'resources' on Instance uuid 569b9815-efc4-46d0-832e-9931fdd7d6ad {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-99590872',display_name='tempest-AttachSCSIVolumeTestJSON-server-99590872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-99590872',id=5,image_ref='e1b28ccf-e7cd-45dd-81df-9dab2477d734',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKz0MrEODXkanaLZBHd3BrUzyWVW0EkImodtIWTOz63VIychSim/6j80u86aPhZKoB6yreySnaVpM93820MdZ4Ao6iRJUrBln1pJ1kCgmtqyvLbl6s2oub95EvyNZSwyTg==',key_name='tempest-keypair-93251947',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:21:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='878175ee02584bcbb6f34320413d5a81',ramdisk_id='',reservation_id='r-bjem0jvv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e1b28ccf-e7cd-45dd-81df-9dab2477d734',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1990932830',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1990932830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45c358e42fcc4d7887547c618f2f1b43',uuid=569b9815-efc4-46d0-832e-9931fdd7d6ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "address": "fa:16:3e:76:54:9c", "network": {"id": "4f26fb82-d023-4342-9035-8726850c06ad", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-819357445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "878175ee02584bcbb6f34320413d5a81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7ff3f5-f2", "ovs_interfaceid": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Converting VIF {"id": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "address": "fa:16:3e:76:54:9c", "network": {"id": "4f26fb82-d023-4342-9035-8726850c06ad", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-819357445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "878175ee02584bcbb6f34320413d5a81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7ff3f5-f2", "ovs_interfaceid": "4b7ff3f5-f222-4af3-905a-acb2ebef3aa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:54:9c,bridge_name='br-int',has_traffic_filtering=True,id=4b7ff3f5-f222-4af3-905a-acb2ebef3aa9,network=Network(4f26fb82-d023-4342-9035-8726850c06ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7ff3f5-f2') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG os_vif [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:54:9c,bridge_name='br-int',has_traffic_filtering=True,id=4b7ff3f5-f222-4af3-905a-acb2ebef3aa9,network=Network(4f26fb82-d023-4342-9035-8726850c06ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7ff3f5-f2') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b7ff3f5-f2, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d10403ea-12bd-4d6a-84f6-f3825806e3ce) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:34 user nova-compute[75018]: INFO os_vif [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:54:9c,bridge_name='br-int',has_traffic_filtering=True,id=4b7ff3f5-f222-4af3-905a-acb2ebef3aa9,network=Network(4f26fb82-d023-4342-9035-8726850c06ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7ff3f5-f2')
Nov 07 15:24:34 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Deleting instance files /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad_del
Nov 07 15:24:34 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Deletion of /opt/stack/data/nova/instances/569b9815-efc4-46d0-832e-9931fdd7d6ad_del complete
Nov 07 15:24:34 user nova-compute[75018]: INFO nova.compute.manager [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 07 15:24:34 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:24:34 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Instance spawned successfully.
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:24:35 user nova-compute[75018]: INFO nova.compute.manager [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Took 6.93 seconds to spawn the instance on the hypervisor.
Nov 07 15:24:35 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:24:35 user nova-compute[75018]: INFO nova.compute.manager [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Took 8.78 seconds to build instance.
Nov 07 15:24:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe5374e2-eccd-4123-812a-33d51153bace tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.936s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:35 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:24:35 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Took 0.91 seconds to deallocate network for instance.
Nov 07 15:24:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-39fd3dc7-98b1-42ec-86c3-7b16c00001d1 req-22b0964d-8f41-4c4f-b0ab-6032b0f61d2b service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Received event network-vif-deleted-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-fb08b338-1a97-4c8f-b8d1-b1972140d4ae req-804b5225-a3d1-41c7-b0e4-d64d6500d584 service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Received event network-vif-plugged-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fb08b338-1a97-4c8f-b8d1-b1972140d4ae req-804b5225-a3d1-41c7-b0e4-d64d6500d584 service nova] Acquiring lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fb08b338-1a97-4c8f-b8d1-b1972140d4ae req-804b5225-a3d1-41c7-b0e4-d64d6500d584 service nova] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fb08b338-1a97-4c8f-b8d1-b1972140d4ae req-804b5225-a3d1-41c7-b0e4-d64d6500d584 service nova] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-fb08b338-1a97-4c8f-b8d1-b1972140d4ae req-804b5225-a3d1-41c7-b0e4-d64d6500d584 service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] No waiting events found dispatching network-vif-plugged-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:36 user nova-compute[75018]: WARNING nova.compute.manager [req-fb08b338-1a97-4c8f-b8d1-b1972140d4ae req-804b5225-a3d1-41c7-b0e4-d64d6500d584 service nova] [instance: 569b9815-efc4-46d0-832e-9931fdd7d6ad] Received unexpected event network-vif-plugged-4b7ff3f5-f222-4af3-905a-acb2ebef3aa9 for instance with vm_state deleted and task_state None.
Nov 07 15:24:36 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d5341681-9ba6-4f21-a67c-00d50aea8762 is timed out.
Nov 07 15:24:36 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Successfully detached device vdb from instance d5341681-9ba6-4f21-a67c-00d50aea8762 from the live domain config.
Nov 07 15:24:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUXPOQKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:36 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.543s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.040s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f342eb65-663e-4174-b61a-8c11e2dfb06b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:24:36 user nova-compute[75018]: No targets found.
Nov 07 15:24:36 user nova-compute[75018]: iSNS:
Nov 07 15:24:36 user nova-compute[75018]: No targets found.
Nov 07 15:24:36 user nova-compute[75018]: STATIC:
Nov 07 15:24:36 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3
Nov 07 15:24:36 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:36 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:36 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c
Nov 07 15:24:36 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:36 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:36 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042
Nov 07 15:24:36 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:36 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:36 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1
Nov 07 15:24:36 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:36 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:36 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a
Nov 07 15:24:36 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:36 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:36 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867
Nov 07 15:24:36 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:36 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:36 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:24:36 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:36 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:36 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6
Nov 07 15:24:36 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:36 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:36 user nova-compute[75018]: FIRMWARE:
Nov 07 15:24:36 user nova-compute[75018]: No targets found.
Nov 07 15:24:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:24:36 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:24:36 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:36 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Deleted allocations for instance 569b9815-efc4-46d0-832e-9931fdd7d6ad
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9662f6-fc7d-4fa8-a917-0378dfcf8c87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[596506f6-74d4-4558-9ca8-68e37d006089]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:36 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:36 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:36 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:36 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:36 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:36 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:36 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:36 user nova-compute[75018]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c (non-flash)
Nov 07 15:24:36 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:36 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:36 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:36 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:36 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:36 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae0763880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c'): ({'sdi'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Removing single pathed devices sdi {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae6cce0-d24d-47d8-8b3d-9991bcbe0751]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5b53d2-2089-43bb-a841-f9d16da9b0bb]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Flushing IO for device /dev/sdi {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7a0f4e-dcc5-4972-95f2-ecc46b5259ac]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-326c277d-38ac-474b-b719-42c91674a890 tempest-AttachSCSIVolumeTestJSON-1990932830 tempest-AttachSCSIVolumeTestJSON-1990932830-project-member] Lock "569b9815-efc4-46d0-832e-9931fdd7d6ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.762s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.046s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d354fd-cde7-466f-ae35-ff1bf8ddbb56]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] SCSI volumes sdi have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5ed447-4846-416c-8cc8-879df96f050b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[923b151d-15d4-4c6e-847a-49838ac2def0]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c, portal: 172.16.0.220,3260]
Nov 07 15:24:36 user nova-compute[75018]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c, portal: 172.16.0.220,3260] successful.
Nov 07 15:24:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ee9fe1-1cb0-4307-a92f-81baa76d5e6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c00ef9-1d9b-4030-b704-3abcbc177c95]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] <== disconnect_volume: return (414ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:24:37 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lazy-loading 'flavor' on Instance uuid d5341681-9ba6-4f21-a67c-00d50aea8762 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae850c6f-202d-43d7-8134-4a5b538c0675 tempest-VolumesAssistedSnapshotsTest-684831046 tempest-VolumesAssistedSnapshotsTest-684831046-project-admin] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.294s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUpZxbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:48 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:48 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:48 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bb2382-d83a-4d73-8a84-e651519d2657]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:24:48 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[706ddf8c-d3fc-48ce-8a51-e5ea31ba8e99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf] added
Nov 07 15:24:48 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0cf35b-1430-4504-8dd3-be61db03e969]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a19111-de3b-490d-9209-df7fdc2ba3dc]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXUpZxbi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXUpZxbi" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc450e24-1875-404d-87e7-490201f1f848]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lXUpZxbi'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9ba8ff-6908-47ea-8ed6-395bd75975e6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a32696-e94c-46b3-9a3b-2a30e9285a69]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[889bf123-ecee-4675-98b2-6e700af6108a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260]
Nov 07 15:24:49 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260] successful.
Nov 07 15:24:49 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9ea875-4e74-474c-903d-b17b2f9dc09d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[930a3841-c398-45cb-93d3-54b7ba68192f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:49 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6694571-4af7-4833-bb33-686dfc38a976]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUpZxbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23736633539383037', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736633539383037', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG nova.objects.instance [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lazy-loading 'flavor' on Instance uuid 8257c590-204a-4fde-8487-79b8c0c87ea7 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:24:50 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:24:50 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:24:50 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:24:50 user nova-compute[75018]:   <serial>f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf</serial>
Nov 07 15:24:50 user nova-compute[75018]: </disk>
Nov 07 15:24:50 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:24:50 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Waiting for libvirt event about the detach of device tap59996421-4e with device alias net1 from instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 is timed out.
Nov 07 15:24:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b8:5e:1e"/><model type="virtio"/><mtu size="1442"/><target dev="tap59996421-4e"/></interface> {{(pid=75018) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b8:5e:1e"/><model type="virtio"/><mtu size="1442"/><target dev="tap59996421-4e"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 07 15:24:50 user nova-compute[75018]:   <name>instance-00000006</name>
Nov 07 15:24:50 user nova-compute[75018]:   <uuid>f9efb536-b47e-4e87-bc54-fdf69cacf8e3</uuid>
Nov 07 15:24:50 user nova-compute[75018]:   <metadata>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:24:50 user nova-compute[75018]:   <nova:package version="0.0.0"/>
Nov 07 15:24:50 user nova-compute[75018]:   <nova:name>tempest-device-tagging-server-1580286647</nova:name>
Nov 07 15:24:50 user nova-compute[75018]:   <nova:creationTime>2023-11-07 15:22:53</nova:creationTime>
Nov 07 15:24:50 user nova-compute[75018]:   <nova:flavor name="m1.tiny">
Nov 07 15:24:50 user nova-compute[75018]:     <nova:memory>512</nova:memory>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:disk>1</nova:disk>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:swap>0</nova:swap>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:vcpus>1</nova:vcpus>
Nov 07 15:24:50 user nova-compute[75018]:   </nova:flavor>
Nov 07 15:24:50 user nova-compute[75018]:   <nova:owner>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:user uuid="8dd118649a4241bb95956240a2393048">tempest-TaggedAttachmentsTest-2013364869-project-member</nova:user>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:project uuid="5c9868af5b9d4666b842470b30e169d2">tempest-TaggedAttachmentsTest-2013364869</nova:project>
Nov 07 15:24:50 user nova-compute[75018]:   </nova:owner>
Nov 07 15:24:50 user nova-compute[75018]:   <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:24:50 user nova-compute[75018]:   <nova:ports>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:port uuid="5b3da5d6-6cee-4668-b7cd-5d328309eca6">
Nov 07 15:24:50 user nova-compute[75018]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 07 15:24:50 user nova-compute[75018]:     </nova:port>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:port uuid="59996421-4eca-48d7-a613-1e938d23fc17">
Nov 07 15:24:50 user nova-compute[75018]:       <nova:ip type="fixed" address="10.10.10.97" ipVersion="4"/>
Nov 07 15:24:50 user nova-compute[75018]:     </nova:port>
Nov 07 15:24:50 user nova-compute[75018]:   </nova:ports>
Nov 07 15:24:50 user nova-compute[75018]: </nova:instance>
Nov 07 15:24:50 user nova-compute[75018]:   </metadata>
Nov 07 15:24:50 user nova-compute[75018]:   <memory unit='KiB'>524288</memory>
Nov 07 15:24:50 user nova-compute[75018]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 07 15:24:50 user nova-compute[75018]:   <vcpu placement='static'>1</vcpu>
Nov 07 15:24:50 user nova-compute[75018]:   <resource>
Nov 07 15:24:50 user nova-compute[75018]:     <partition>/machine</partition>
Nov 07 15:24:50 user nova-compute[75018]:   </resource>
Nov 07 15:24:50 user nova-compute[75018]:   <sysinfo type='smbios'>
Nov 07 15:24:50 user nova-compute[75018]:     <system>
Nov 07 15:24:50 user nova-compute[75018]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 07 15:24:50 user nova-compute[75018]:       <entry name='product'>OpenStack Nova</entry>
Nov 07 15:24:50 user nova-compute[75018]:       <entry name='version'>0.0.0</entry>
Nov 07 15:24:50 user nova-compute[75018]:       <entry name='serial'>f9efb536-b47e-4e87-bc54-fdf69cacf8e3</entry>
Nov 07 15:24:50 user nova-compute[75018]:       <entry name='uuid'>f9efb536-b47e-4e87-bc54-fdf69cacf8e3</entry>
Nov 07 15:24:50 user nova-compute[75018]:       <entry name='family'>Virtual Machine</entry>
Nov 07 15:24:50 user nova-compute[75018]:     </system>
Nov 07 15:24:50 user nova-compute[75018]:   </sysinfo>
Nov 07 15:24:50 user nova-compute[75018]:   <os>
Nov 07 15:24:50 user nova-compute[75018]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 07 15:24:50 user nova-compute[75018]:     <boot dev='hd'/>
Nov 07 15:24:50 user nova-compute[75018]:     <smbios mode='sysinfo'/>
Nov 07 15:24:50 user nova-compute[75018]:   </os>
Nov 07 15:24:50 user nova-compute[75018]:   <features>
Nov 07 15:24:50 user nova-compute[75018]:     <acpi/>
Nov 07 15:24:50 user nova-compute[75018]:     <apic/>
Nov 07 15:24:50 user nova-compute[75018]:     <vmcoreinfo state='on'/>
Nov 07 15:24:50 user nova-compute[75018]:   </features>
Nov 07 15:24:50 user nova-compute[75018]:   <cpu mode='custom' match='exact' check='full'>
Nov 07 15:24:50 user nova-compute[75018]:     <model fallback='forbid'>Nehalem</model>
Nov 07 15:24:50 user nova-compute[75018]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 07 15:24:50 user nova-compute[75018]:     <feature policy='require' name='vme'/>
Nov 07 15:24:50 user nova-compute[75018]:     <feature policy='require' name='x2apic'/>
Nov 07 15:24:50 user nova-compute[75018]:     <feature policy='require' name='hypervisor'/>
Nov 07 15:24:50 user nova-compute[75018]:   </cpu>
Nov 07 15:24:50 user nova-compute[75018]:   <clock offset='utc'>
Nov 07 15:24:50 user nova-compute[75018]:     <timer name='pit' tickpolicy='delay'/>
Nov 07 15:24:50 user nova-compute[75018]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 07 15:24:50 user nova-compute[75018]:     <timer name='hpet' present='no'/>
Nov 07 15:24:50 user nova-compute[75018]:   </clock>
Nov 07 15:24:50 user nova-compute[75018]:   <on_poweroff>destroy</on_poweroff>
Nov 07 15:24:50 user nova-compute[75018]:   <on_reboot>restart</on_reboot>
Nov 07 15:24:50 user nova-compute[75018]:   <on_crash>destroy</on_crash>
Nov 07 15:24:50 user nova-compute[75018]:   <devices>
Nov 07 15:24:50 user nova-compute[75018]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 07 15:24:50 user nova-compute[75018]:     <disk type='file' device='disk'>
Nov 07 15:24:50 user nova-compute[75018]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 07 15:24:50 user nova-compute[75018]:       <source file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk' index='2'/>
Nov 07 15:24:50 user nova-compute[75018]:       <backingStore type='file' index='3'>
Nov 07 15:24:50 user nova-compute[75018]:         <format type='raw'/>
Nov 07 15:24:50 user nova-compute[75018]:         <source file='/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e'/>
Nov 07 15:24:50 user nova-compute[75018]:         <backingStore/>
Nov 07 15:24:50 user nova-compute[75018]:       </backingStore>
Nov 07 15:24:50 user nova-compute[75018]:       <target dev='vda' bus='virtio'/>
Nov 07 15:24:50 user nova-compute[75018]:       <alias name='virtio-disk0'/>
Nov 07 15:24:50 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 07 15:24:50 user nova-compute[75018]:     </disk>
Nov 07 15:24:50 user nova-compute[75018]:     <disk type='file' device='cdrom'>
Nov 07 15:24:50 user nova-compute[75018]:       <driver name='qemu' type='raw' cache='none'/>
Nov 07 15:24:50 user nova-compute[75018]:       <source file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk.config' index='1'/>
Nov 07 15:24:50 user nova-compute[75018]:       <backingStore/>
Nov 07 15:24:50 user nova-compute[75018]:       <target dev='hda' bus='ide'/>
Nov 07 15:24:50 user nova-compute[75018]:       <readonly/>
Nov 07 15:24:50 user nova-compute[75018]:       <alias name='ide0-0-0'/>
Nov 07 15:24:50 user nova-compute[75018]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 07 15:24:50 user nova-compute[75018]:     </disk>
Nov 07 15:24:50 user nova-compute[75018]:     <controller type='usb' index='0' model='none'>
Nov 07 15:24:50 user nova-compute[75018]:       <alias name='usb'/>
Nov 07 15:24:50 user nova-compute[75018]:     </controller>
Nov 07 15:24:50 user nova-compute[75018]:     <controller type='pci' index='0' model='pci-root'>
Nov 07 15:24:50 user nova-compute[75018]:       <alias name='pci.0'/>
Nov 07 15:24:50 user nova-compute[75018]:     </controller>
Nov 07 15:24:50 user nova-compute[75018]:     <controller type='ide' index='0'>
Nov 07 15:24:50 user nova-compute[75018]:       <alias name='ide'/>
Nov 07 15:24:50 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 07 15:24:50 user nova-compute[75018]:     </controller>
Nov 07 15:24:50 user nova-compute[75018]:     <interface type='ethernet'>
Nov 07 15:24:50 user nova-compute[75018]:       <mac address='fa:16:3e:e1:55:2d'/>
Nov 07 15:24:50 user nova-compute[75018]:       <target dev='tap5b3da5d6-6c'/>
Nov 07 15:24:50 user nova-compute[75018]:       <model type='virtio'/>
Nov 07 15:24:50 user nova-compute[75018]:       <mtu size='1442'/>
Nov 07 15:24:50 user nova-compute[75018]:       <alias name='net0'/>
Nov 07 15:24:50 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 07 15:24:50 user nova-compute[75018]:     </interface>
Nov 07 15:24:50 user nova-compute[75018]:     <serial type='pty'>
Nov 07 15:24:50 user nova-compute[75018]:       <source path='/dev/pts/5'/>
Nov 07 15:24:50 user nova-compute[75018]:       <log file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/console.log' append='off'/>
Nov 07 15:24:50 user nova-compute[75018]:       <target type='isa-serial' port='0'>
Nov 07 15:24:50 user nova-compute[75018]:         <model name='isa-serial'/>
Nov 07 15:24:50 user nova-compute[75018]:       </target>
Nov 07 15:24:50 user nova-compute[75018]:       <alias name='serial0'/>
Nov 07 15:24:50 user nova-compute[75018]:     </serial>
Nov 07 15:24:50 user nova-compute[75018]:     <console type='pty' tty='/dev/pts/5'>
Nov 07 15:24:50 user nova-compute[75018]:       <source path='/dev/pts/5'/>
Nov 07 15:24:50 user nova-compute[75018]:       <log file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/console.log' append='off'/>
Nov 07 15:24:50 user nova-compute[75018]:       <target type='serial' port='0'/>
Nov 07 15:24:50 user nova-compute[75018]:       <alias name='serial0'/>
Nov 07 15:24:50 user nova-compute[75018]:     </console>
Nov 07 15:24:50 user nova-compute[75018]:     <input type='mouse' bus='ps2'>
Nov 07 15:24:50 user nova-compute[75018]:       <alias name='input0'/>
Nov 07 15:24:50 user nova-compute[75018]:     </input>
Nov 07 15:24:50 user nova-compute[75018]:     <input type='keyboard' bus='ps2'>
Nov 07 15:24:50 user nova-compute[75018]:       <alias name='input1'/>
Nov 07 15:24:50 user nova-compute[75018]:     </input>
Nov 07 15:24:50 user nova-compute[75018]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 07 15:24:50 user nova-compute[75018]:       <listen type='address' address='0.0.0.0'/>
Nov 07 15:24:50 user nova-compute[75018]:     </graphics>
Nov 07 15:24:50 user nova-compute[75018]:     <audio id='1' type='none'/>
Nov 07 15:24:50 user nova-compute[75018]:     <video>
Nov 07 15:24:50 user nova-compute[75018]:       <model type='virtio' heads='1' primary='yes'/>
Nov 07 15:24:50 user nova-compute[75018]:       <alias name='video0'/>
Nov 07 15:24:50 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 07 15:24:50 user nova-compute[75018]:     </video>
Nov 07 15:24:50 user nova-compute[75018]:     <memballoon model='virtio'>
Nov 07 15:24:50 user nova-compute[75018]:       <stats period='10'/>
Nov 07 15:24:50 user nova-compute[75018]:       <alias name='balloon0'/>
Nov 07 15:24:50 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 07 15:24:50 user nova-compute[75018]:     </memballoon>
Nov 07 15:24:50 user nova-compute[75018]:     <rng model='virtio'>
Nov 07 15:24:50 user nova-compute[75018]:       <backend model='random'>/dev/urandom</backend>
Nov 07 15:24:50 user nova-compute[75018]:       <alias name='rng0'/>
Nov 07 15:24:50 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 07 15:24:50 user nova-compute[75018]:     </rng>
Nov 07 15:24:50 user nova-compute[75018]:   </devices>
Nov 07 15:24:50 user nova-compute[75018]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 07 15:24:50 user nova-compute[75018]:     <label>libvirt-f9efb536-b47e-4e87-bc54-fdf69cacf8e3</label>
Nov 07 15:24:50 user nova-compute[75018]:     <imagelabel>libvirt-f9efb536-b47e-4e87-bc54-fdf69cacf8e3</imagelabel>
Nov 07 15:24:50 user nova-compute[75018]:   </seclabel>
Nov 07 15:24:50 user nova-compute[75018]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 07 15:24:50 user nova-compute[75018]:     <label>+64055:+108</label>
Nov 07 15:24:50 user nova-compute[75018]:     <imagelabel>+64055:+108</imagelabel>
Nov 07 15:24:50 user nova-compute[75018]:   </seclabel>
Nov 07 15:24:50 user nova-compute[75018]: </domain>
Nov 07 15:24:50 user nova-compute[75018]:  {{(pid=75018) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 07 15:24:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Successfully detached device tap59996421-4e from instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3 from the live domain config.
Nov 07 15:24:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1580286647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1580286647',id=6,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBa2umF2j3NFcrA/MMVfFX9CwszOvYSV953cPLJB8Fg9xF6mpuVYI1nrRM/8pACoITM+FQT+M6FG3/0v9UsQ2UUg5VLULbr4xVkSLj0F171iDoJzrj+ppTAogqlmzzug==',key_name='tempest-keypair-464082042',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:21:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c9868af5b9d4666b842470b30e169d2',ramdisk_id='',reservation_id='r-tw13f7f8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2013364869',owner_user_name='tempest-TaggedAttachmentsTest-2013364869-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:21:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd118649a4241bb95956240a2393048',uuid=f9efb536-b47e-4e87-bc54-fdf69cacf8e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59996421-4eca-48d7-a613-1e938d23fc17", "address": "fa:16:3e:b8:5e:1e", "network": {"id": "8b16abf0-67a0-46d6-b688-5059b2dd37e9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1556414992", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59996421-4e", "ovs_interfaceid": "59996421-4eca-48d7-a613-1e938d23fc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Converting VIF {"id": "59996421-4eca-48d7-a613-1e938d23fc17", "address": "fa:16:3e:b8:5e:1e", "network": {"id": "8b16abf0-67a0-46d6-b688-5059b2dd37e9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1556414992", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59996421-4e", "ovs_interfaceid": "59996421-4eca-48d7-a613-1e938d23fc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:1e,bridge_name='br-int',has_traffic_filtering=True,id=59996421-4eca-48d7-a613-1e938d23fc17,network=Network(8b16abf0-67a0-46d6-b688-5059b2dd37e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59996421-4e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG os_vif [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:1e,bridge_name='br-int',has_traffic_filtering=True,id=59996421-4eca-48d7-a613-1e938d23fc17,network=Network(8b16abf0-67a0-46d6-b688-5059b2dd37e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59996421-4e') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59996421-4e, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27eaa43d-48e0-4f0c-a3be-eaeb6be58df9) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:50 user nova-compute[75018]: INFO os_vif [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:1e,bridge_name='br-int',has_traffic_filtering=True,id=59996421-4eca-48d7-a613-1e938d23fc17,network=Network(8b16abf0-67a0-46d6-b688-5059b2dd37e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59996421-4e')
Nov 07 15:24:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:24:50 user nova-compute[75018]:   <nova:package version="0.0.0"/>
Nov 07 15:24:50 user nova-compute[75018]:   <nova:name>tempest-device-tagging-server-1580286647</nova:name>
Nov 07 15:24:50 user nova-compute[75018]:   <nova:creationTime>2023-11-07 15:24:50</nova:creationTime>
Nov 07 15:24:50 user nova-compute[75018]:   <nova:flavor name="m1.tiny">
Nov 07 15:24:50 user nova-compute[75018]:     <nova:memory>512</nova:memory>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:disk>1</nova:disk>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:swap>0</nova:swap>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:vcpus>1</nova:vcpus>
Nov 07 15:24:50 user nova-compute[75018]:   </nova:flavor>
Nov 07 15:24:50 user nova-compute[75018]:   <nova:owner>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:user uuid="8dd118649a4241bb95956240a2393048">tempest-TaggedAttachmentsTest-2013364869-project-member</nova:user>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:project uuid="5c9868af5b9d4666b842470b30e169d2">tempest-TaggedAttachmentsTest-2013364869</nova:project>
Nov 07 15:24:50 user nova-compute[75018]:   </nova:owner>
Nov 07 15:24:50 user nova-compute[75018]:   <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:24:50 user nova-compute[75018]:   <nova:ports>
Nov 07 15:24:50 user nova-compute[75018]:     <nova:port uuid="5b3da5d6-6cee-4668-b7cd-5d328309eca6">
Nov 07 15:24:50 user nova-compute[75018]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 07 15:24:50 user nova-compute[75018]:     </nova:port>
Nov 07 15:24:50 user nova-compute[75018]:   </nova:ports>
Nov 07 15:24:50 user nova-compute[75018]: </nova:instance>
Nov 07 15:24:50 user nova-compute[75018]:  {{(pid=75018) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] No VIF found with MAC fa:16:3e:a6:52:2c, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:24:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6242633e-89b4-4890-82ab-ae5be1cdbbd8 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.865s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received event network-vif-deleted-59996421-4eca-48d7-a613-1e938d23fc17 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:51 user nova-compute[75018]: INFO nova.compute.manager [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Neutron deleted interface 59996421-4eca-48d7-a613-1e938d23fc17; detaching it from the instance and deleting it from the info cache
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.network.neutron [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Updating instance_info_cache with network_info: [{"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquired lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.objects.instance [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] Lazy-loading 'system_metadata' on Instance uuid f9efb536-b47e-4e87-bc54-fdf69cacf8e3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.objects.instance [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] Lazy-loading 'flavor' on Instance uuid f9efb536-b47e-4e87-bc54-fdf69cacf8e3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.objects.base [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] Object Instance<f9efb536-b47e-4e87-bc54-fdf69cacf8e3> lazy-loaded attributes: system_metadata,flavor {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1580286647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1580286647',id=6,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBa2umF2j3NFcrA/MMVfFX9CwszOvYSV953cPLJB8Fg9xF6mpuVYI1nrRM/8pACoITM+FQT+M6FG3/0v9UsQ2UUg5VLULbr4xVkSLj0F171iDoJzrj+ppTAogqlmzzug==',key_name='tempest-keypair-464082042',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:21:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c9868af5b9d4666b842470b30e169d2',ramdisk_id='',reservation_id='r-tw13f7f8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2013364869',owner_user_name='tempest-TaggedAttachmentsTest-2013364869-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:21:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd118649a4241bb95956240a2393048',uuid=f9efb536-b47e-4e87-bc54-fdf69cacf8e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59996421-4eca-48d7-a613-1e938d23fc17", "address": "fa:16:3e:b8:5e:1e", "network": {"id": "8b16abf0-67a0-46d6-b688-5059b2dd37e9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1556414992", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59996421-4e", "ovs_interfaceid": "59996421-4eca-48d7-a613-1e938d23fc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.network.os_vif_util [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] Converting VIF {"id": "59996421-4eca-48d7-a613-1e938d23fc17", "address": "fa:16:3e:b8:5e:1e", "network": {"id": "8b16abf0-67a0-46d6-b688-5059b2dd37e9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1556414992", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59996421-4e", "ovs_interfaceid": "59996421-4eca-48d7-a613-1e938d23fc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.network.os_vif_util [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:1e,bridge_name='br-int',has_traffic_filtering=True,id=59996421-4eca-48d7-a613-1e938d23fc17,network=Network(8b16abf0-67a0-46d6-b688-5059b2dd37e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59996421-4e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b8:5e:1e"/><model type="virtio"/><mtu size="1442"/><target dev="tap59996421-4e"/></interface> {{(pid=75018) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b8:5e:1e"/><model type="virtio"/><mtu size="1442"/><target dev="tap59996421-4e"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 07 15:24:51 user nova-compute[75018]:   <name>instance-00000006</name>
Nov 07 15:24:51 user nova-compute[75018]:   <uuid>f9efb536-b47e-4e87-bc54-fdf69cacf8e3</uuid>
Nov 07 15:24:51 user nova-compute[75018]:   <metadata>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:24:51 user nova-compute[75018]:   <nova:package version="0.0.0"/>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:name>tempest-device-tagging-server-1580286647</nova:name>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:creationTime>2023-11-07 15:24:50</nova:creationTime>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:flavor name="m1.tiny">
Nov 07 15:24:51 user nova-compute[75018]:     <nova:memory>512</nova:memory>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:disk>1</nova:disk>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:swap>0</nova:swap>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:vcpus>1</nova:vcpus>
Nov 07 15:24:51 user nova-compute[75018]:   </nova:flavor>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:owner>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:user uuid="8dd118649a4241bb95956240a2393048">tempest-TaggedAttachmentsTest-2013364869-project-member</nova:user>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:project uuid="5c9868af5b9d4666b842470b30e169d2">tempest-TaggedAttachmentsTest-2013364869</nova:project>
Nov 07 15:24:51 user nova-compute[75018]:   </nova:owner>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:ports>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:port uuid="5b3da5d6-6cee-4668-b7cd-5d328309eca6">
Nov 07 15:24:51 user nova-compute[75018]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 07 15:24:51 user nova-compute[75018]:     </nova:port>
Nov 07 15:24:51 user nova-compute[75018]:   </nova:ports>
Nov 07 15:24:51 user nova-compute[75018]: </nova:instance>
Nov 07 15:24:51 user nova-compute[75018]:   </metadata>
Nov 07 15:24:51 user nova-compute[75018]:   <memory unit='KiB'>524288</memory>
Nov 07 15:24:51 user nova-compute[75018]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 07 15:24:51 user nova-compute[75018]:   <vcpu placement='static'>1</vcpu>
Nov 07 15:24:51 user nova-compute[75018]:   <resource>
Nov 07 15:24:51 user nova-compute[75018]:     <partition>/machine</partition>
Nov 07 15:24:51 user nova-compute[75018]:   </resource>
Nov 07 15:24:51 user nova-compute[75018]:   <sysinfo type='smbios'>
Nov 07 15:24:51 user nova-compute[75018]:     <system>
Nov 07 15:24:51 user nova-compute[75018]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 07 15:24:51 user nova-compute[75018]:       <entry name='product'>OpenStack Nova</entry>
Nov 07 15:24:51 user nova-compute[75018]:       <entry name='version'>0.0.0</entry>
Nov 07 15:24:51 user nova-compute[75018]:       <entry name='serial'>f9efb536-b47e-4e87-bc54-fdf69cacf8e3</entry>
Nov 07 15:24:51 user nova-compute[75018]:       <entry name='uuid'>f9efb536-b47e-4e87-bc54-fdf69cacf8e3</entry>
Nov 07 15:24:51 user nova-compute[75018]:       <entry name='family'>Virtual Machine</entry>
Nov 07 15:24:51 user nova-compute[75018]:     </system>
Nov 07 15:24:51 user nova-compute[75018]:   </sysinfo>
Nov 07 15:24:51 user nova-compute[75018]:   <os>
Nov 07 15:24:51 user nova-compute[75018]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 07 15:24:51 user nova-compute[75018]:     <boot dev='hd'/>
Nov 07 15:24:51 user nova-compute[75018]:     <smbios mode='sysinfo'/>
Nov 07 15:24:51 user nova-compute[75018]:   </os>
Nov 07 15:24:51 user nova-compute[75018]:   <features>
Nov 07 15:24:51 user nova-compute[75018]:     <acpi/>
Nov 07 15:24:51 user nova-compute[75018]:     <apic/>
Nov 07 15:24:51 user nova-compute[75018]:     <vmcoreinfo state='on'/>
Nov 07 15:24:51 user nova-compute[75018]:   </features>
Nov 07 15:24:51 user nova-compute[75018]:   <cpu mode='custom' match='exact' check='full'>
Nov 07 15:24:51 user nova-compute[75018]:     <model fallback='forbid'>Nehalem</model>
Nov 07 15:24:51 user nova-compute[75018]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 07 15:24:51 user nova-compute[75018]:     <feature policy='require' name='vme'/>
Nov 07 15:24:51 user nova-compute[75018]:     <feature policy='require' name='x2apic'/>
Nov 07 15:24:51 user nova-compute[75018]:     <feature policy='require' name='hypervisor'/>
Nov 07 15:24:51 user nova-compute[75018]:   </cpu>
Nov 07 15:24:51 user nova-compute[75018]:   <clock offset='utc'>
Nov 07 15:24:51 user nova-compute[75018]:     <timer name='pit' tickpolicy='delay'/>
Nov 07 15:24:51 user nova-compute[75018]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 07 15:24:51 user nova-compute[75018]:     <timer name='hpet' present='no'/>
Nov 07 15:24:51 user nova-compute[75018]:   </clock>
Nov 07 15:24:51 user nova-compute[75018]:   <on_poweroff>destroy</on_poweroff>
Nov 07 15:24:51 user nova-compute[75018]:   <on_reboot>restart</on_reboot>
Nov 07 15:24:51 user nova-compute[75018]:   <on_crash>destroy</on_crash>
Nov 07 15:24:51 user nova-compute[75018]:   <devices>
Nov 07 15:24:51 user nova-compute[75018]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 07 15:24:51 user nova-compute[75018]:     <disk type='file' device='disk'>
Nov 07 15:24:51 user nova-compute[75018]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 07 15:24:51 user nova-compute[75018]:       <source file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk' index='2'/>
Nov 07 15:24:51 user nova-compute[75018]:       <backingStore type='file' index='3'>
Nov 07 15:24:51 user nova-compute[75018]:         <format type='raw'/>
Nov 07 15:24:51 user nova-compute[75018]:         <source file='/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e'/>
Nov 07 15:24:51 user nova-compute[75018]:         <backingStore/>
Nov 07 15:24:51 user nova-compute[75018]:       </backingStore>
Nov 07 15:24:51 user nova-compute[75018]:       <target dev='vda' bus='virtio'/>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='virtio-disk0'/>
Nov 07 15:24:51 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </disk>
Nov 07 15:24:51 user nova-compute[75018]:     <disk type='file' device='cdrom'>
Nov 07 15:24:51 user nova-compute[75018]:       <driver name='qemu' type='raw' cache='none'/>
Nov 07 15:24:51 user nova-compute[75018]:       <source file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk.config' index='1'/>
Nov 07 15:24:51 user nova-compute[75018]:       <backingStore/>
Nov 07 15:24:51 user nova-compute[75018]:       <target dev='hda' bus='ide'/>
Nov 07 15:24:51 user nova-compute[75018]:       <readonly/>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='ide0-0-0'/>
Nov 07 15:24:51 user nova-compute[75018]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </disk>
Nov 07 15:24:51 user nova-compute[75018]:     <controller type='usb' index='0' model='none'>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='usb'/>
Nov 07 15:24:51 user nova-compute[75018]:     </controller>
Nov 07 15:24:51 user nova-compute[75018]:     <controller type='pci' index='0' model='pci-root'>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='pci.0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </controller>
Nov 07 15:24:51 user nova-compute[75018]:     <controller type='ide' index='0'>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='ide'/>
Nov 07 15:24:51 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 07 15:24:51 user nova-compute[75018]:     </controller>
Nov 07 15:24:51 user nova-compute[75018]:     <interface type='ethernet'>
Nov 07 15:24:51 user nova-compute[75018]:       <mac address='fa:16:3e:e1:55:2d'/>
Nov 07 15:24:51 user nova-compute[75018]:       <target dev='tap5b3da5d6-6c'/>
Nov 07 15:24:51 user nova-compute[75018]:       <model type='virtio'/>
Nov 07 15:24:51 user nova-compute[75018]:       <mtu size='1442'/>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='net0'/>
Nov 07 15:24:51 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </interface>
Nov 07 15:24:51 user nova-compute[75018]:     <serial type='pty'>
Nov 07 15:24:51 user nova-compute[75018]:       <source path='/dev/pts/5'/>
Nov 07 15:24:51 user nova-compute[75018]:       <log file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/console.log' append='off'/>
Nov 07 15:24:51 user nova-compute[75018]:       <target type='isa-serial' port='0'>
Nov 07 15:24:51 user nova-compute[75018]:         <model name='isa-serial'/>
Nov 07 15:24:51 user nova-compute[75018]:       </target>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='serial0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </serial>
Nov 07 15:24:51 user nova-compute[75018]:     <console type='pty' tty='/dev/pts/5'>
Nov 07 15:24:51 user nova-compute[75018]:       <source path='/dev/pts/5'/>
Nov 07 15:24:51 user nova-compute[75018]:       <log file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/console.log' append='off'/>
Nov 07 15:24:51 user nova-compute[75018]:       <target type='serial' port='0'/>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='serial0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </console>
Nov 07 15:24:51 user nova-compute[75018]:     <input type='mouse' bus='ps2'>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='input0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </input>
Nov 07 15:24:51 user nova-compute[75018]:     <input type='keyboard' bus='ps2'>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='input1'/>
Nov 07 15:24:51 user nova-compute[75018]:     </input>
Nov 07 15:24:51 user nova-compute[75018]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 07 15:24:51 user nova-compute[75018]:       <listen type='address' address='0.0.0.0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </graphics>
Nov 07 15:24:51 user nova-compute[75018]:     <audio id='1' type='none'/>
Nov 07 15:24:51 user nova-compute[75018]:     <video>
Nov 07 15:24:51 user nova-compute[75018]:       <model type='virtio' heads='1' primary='yes'/>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='video0'/>
Nov 07 15:24:51 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </video>
Nov 07 15:24:51 user nova-compute[75018]:     <memballoon model='virtio'>
Nov 07 15:24:51 user nova-compute[75018]:       <stats period='10'/>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='balloon0'/>
Nov 07 15:24:51 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </memballoon>
Nov 07 15:24:51 user nova-compute[75018]:     <rng model='virtio'>
Nov 07 15:24:51 user nova-compute[75018]:       <backend model='random'>/dev/urandom</backend>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='rng0'/>
Nov 07 15:24:51 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </rng>
Nov 07 15:24:51 user nova-compute[75018]:   </devices>
Nov 07 15:24:51 user nova-compute[75018]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 07 15:24:51 user nova-compute[75018]:     <label>libvirt-f9efb536-b47e-4e87-bc54-fdf69cacf8e3</label>
Nov 07 15:24:51 user nova-compute[75018]:     <imagelabel>libvirt-f9efb536-b47e-4e87-bc54-fdf69cacf8e3</imagelabel>
Nov 07 15:24:51 user nova-compute[75018]:   </seclabel>
Nov 07 15:24:51 user nova-compute[75018]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 07 15:24:51 user nova-compute[75018]:     <label>+64055:+108</label>
Nov 07 15:24:51 user nova-compute[75018]:     <imagelabel>+64055:+108</imagelabel>
Nov 07 15:24:51 user nova-compute[75018]:   </seclabel>
Nov 07 15:24:51 user nova-compute[75018]: </domain>
Nov 07 15:24:51 user nova-compute[75018]:  {{(pid=75018) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b8:5e:1e"/><model type="virtio"/><mtu size="1442"/><target dev="tap59996421-4e"/></interface> {{(pid=75018) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b8:5e:1e"/><model type="virtio"/><mtu size="1442"/><target dev="tap59996421-4e"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 07 15:24:51 user nova-compute[75018]:   <name>instance-00000006</name>
Nov 07 15:24:51 user nova-compute[75018]:   <uuid>f9efb536-b47e-4e87-bc54-fdf69cacf8e3</uuid>
Nov 07 15:24:51 user nova-compute[75018]:   <metadata>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:24:51 user nova-compute[75018]:   <nova:package version="0.0.0"/>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:name>tempest-device-tagging-server-1580286647</nova:name>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:creationTime>2023-11-07 15:24:50</nova:creationTime>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:flavor name="m1.tiny">
Nov 07 15:24:51 user nova-compute[75018]:     <nova:memory>512</nova:memory>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:disk>1</nova:disk>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:swap>0</nova:swap>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:vcpus>1</nova:vcpus>
Nov 07 15:24:51 user nova-compute[75018]:   </nova:flavor>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:owner>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:user uuid="8dd118649a4241bb95956240a2393048">tempest-TaggedAttachmentsTest-2013364869-project-member</nova:user>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:project uuid="5c9868af5b9d4666b842470b30e169d2">tempest-TaggedAttachmentsTest-2013364869</nova:project>
Nov 07 15:24:51 user nova-compute[75018]:   </nova:owner>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:ports>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:port uuid="5b3da5d6-6cee-4668-b7cd-5d328309eca6">
Nov 07 15:24:51 user nova-compute[75018]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 07 15:24:51 user nova-compute[75018]:     </nova:port>
Nov 07 15:24:51 user nova-compute[75018]:   </nova:ports>
Nov 07 15:24:51 user nova-compute[75018]: </nova:instance>
Nov 07 15:24:51 user nova-compute[75018]:   </metadata>
Nov 07 15:24:51 user nova-compute[75018]:   <memory unit='KiB'>524288</memory>
Nov 07 15:24:51 user nova-compute[75018]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 07 15:24:51 user nova-compute[75018]:   <vcpu placement='static'>1</vcpu>
Nov 07 15:24:51 user nova-compute[75018]:   <resource>
Nov 07 15:24:51 user nova-compute[75018]:     <partition>/machine</partition>
Nov 07 15:24:51 user nova-compute[75018]:   </resource>
Nov 07 15:24:51 user nova-compute[75018]:   <sysinfo type='smbios'>
Nov 07 15:24:51 user nova-compute[75018]:     <system>
Nov 07 15:24:51 user nova-compute[75018]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 07 15:24:51 user nova-compute[75018]:       <entry name='product'>OpenStack Nova</entry>
Nov 07 15:24:51 user nova-compute[75018]:       <entry name='version'>0.0.0</entry>
Nov 07 15:24:51 user nova-compute[75018]:       <entry name='serial'>f9efb536-b47e-4e87-bc54-fdf69cacf8e3</entry>
Nov 07 15:24:51 user nova-compute[75018]:       <entry name='uuid'>f9efb536-b47e-4e87-bc54-fdf69cacf8e3</entry>
Nov 07 15:24:51 user nova-compute[75018]:       <entry name='family'>Virtual Machine</entry>
Nov 07 15:24:51 user nova-compute[75018]:     </system>
Nov 07 15:24:51 user nova-compute[75018]:   </sysinfo>
Nov 07 15:24:51 user nova-compute[75018]:   <os>
Nov 07 15:24:51 user nova-compute[75018]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 07 15:24:51 user nova-compute[75018]:     <boot dev='hd'/>
Nov 07 15:24:51 user nova-compute[75018]:     <smbios mode='sysinfo'/>
Nov 07 15:24:51 user nova-compute[75018]:   </os>
Nov 07 15:24:51 user nova-compute[75018]:   <features>
Nov 07 15:24:51 user nova-compute[75018]:     <acpi/>
Nov 07 15:24:51 user nova-compute[75018]:     <apic/>
Nov 07 15:24:51 user nova-compute[75018]:     <vmcoreinfo state='on'/>
Nov 07 15:24:51 user nova-compute[75018]:   </features>
Nov 07 15:24:51 user nova-compute[75018]:   <cpu mode='custom' match='exact' check='full'>
Nov 07 15:24:51 user nova-compute[75018]:     <model fallback='forbid'>Nehalem</model>
Nov 07 15:24:51 user nova-compute[75018]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 07 15:24:51 user nova-compute[75018]:     <feature policy='require' name='vme'/>
Nov 07 15:24:51 user nova-compute[75018]:     <feature policy='require' name='x2apic'/>
Nov 07 15:24:51 user nova-compute[75018]:     <feature policy='require' name='hypervisor'/>
Nov 07 15:24:51 user nova-compute[75018]:   </cpu>
Nov 07 15:24:51 user nova-compute[75018]:   <clock offset='utc'>
Nov 07 15:24:51 user nova-compute[75018]:     <timer name='pit' tickpolicy='delay'/>
Nov 07 15:24:51 user nova-compute[75018]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 07 15:24:51 user nova-compute[75018]:     <timer name='hpet' present='no'/>
Nov 07 15:24:51 user nova-compute[75018]:   </clock>
Nov 07 15:24:51 user nova-compute[75018]:   <on_poweroff>destroy</on_poweroff>
Nov 07 15:24:51 user nova-compute[75018]:   <on_reboot>restart</on_reboot>
Nov 07 15:24:51 user nova-compute[75018]:   <on_crash>destroy</on_crash>
Nov 07 15:24:51 user nova-compute[75018]:   <devices>
Nov 07 15:24:51 user nova-compute[75018]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 07 15:24:51 user nova-compute[75018]:     <disk type='file' device='disk'>
Nov 07 15:24:51 user nova-compute[75018]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 07 15:24:51 user nova-compute[75018]:       <source file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk' index='2'/>
Nov 07 15:24:51 user nova-compute[75018]:       <backingStore type='file' index='3'>
Nov 07 15:24:51 user nova-compute[75018]:         <format type='raw'/>
Nov 07 15:24:51 user nova-compute[75018]:         <source file='/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e'/>
Nov 07 15:24:51 user nova-compute[75018]:         <backingStore/>
Nov 07 15:24:51 user nova-compute[75018]:       </backingStore>
Nov 07 15:24:51 user nova-compute[75018]:       <target dev='vda' bus='virtio'/>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='virtio-disk0'/>
Nov 07 15:24:51 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </disk>
Nov 07 15:24:51 user nova-compute[75018]:     <disk type='file' device='cdrom'>
Nov 07 15:24:51 user nova-compute[75018]:       <driver name='qemu' type='raw' cache='none'/>
Nov 07 15:24:51 user nova-compute[75018]:       <source file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/disk.config' index='1'/>
Nov 07 15:24:51 user nova-compute[75018]:       <backingStore/>
Nov 07 15:24:51 user nova-compute[75018]:       <target dev='hda' bus='ide'/>
Nov 07 15:24:51 user nova-compute[75018]:       <readonly/>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='ide0-0-0'/>
Nov 07 15:24:51 user nova-compute[75018]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </disk>
Nov 07 15:24:51 user nova-compute[75018]:     <controller type='usb' index='0' model='none'>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='usb'/>
Nov 07 15:24:51 user nova-compute[75018]:     </controller>
Nov 07 15:24:51 user nova-compute[75018]:     <controller type='pci' index='0' model='pci-root'>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='pci.0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </controller>
Nov 07 15:24:51 user nova-compute[75018]:     <controller type='ide' index='0'>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='ide'/>
Nov 07 15:24:51 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 07 15:24:51 user nova-compute[75018]:     </controller>
Nov 07 15:24:51 user nova-compute[75018]:     <interface type='ethernet'>
Nov 07 15:24:51 user nova-compute[75018]:       <mac address='fa:16:3e:e1:55:2d'/>
Nov 07 15:24:51 user nova-compute[75018]:       <target dev='tap5b3da5d6-6c'/>
Nov 07 15:24:51 user nova-compute[75018]:       <model type='virtio'/>
Nov 07 15:24:51 user nova-compute[75018]:       <mtu size='1442'/>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='net0'/>
Nov 07 15:24:51 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </interface>
Nov 07 15:24:51 user nova-compute[75018]:     <serial type='pty'>
Nov 07 15:24:51 user nova-compute[75018]:       <source path='/dev/pts/5'/>
Nov 07 15:24:51 user nova-compute[75018]:       <log file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/console.log' append='off'/>
Nov 07 15:24:51 user nova-compute[75018]:       <target type='isa-serial' port='0'>
Nov 07 15:24:51 user nova-compute[75018]:         <model name='isa-serial'/>
Nov 07 15:24:51 user nova-compute[75018]:       </target>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='serial0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </serial>
Nov 07 15:24:51 user nova-compute[75018]:     <console type='pty' tty='/dev/pts/5'>
Nov 07 15:24:51 user nova-compute[75018]:       <source path='/dev/pts/5'/>
Nov 07 15:24:51 user nova-compute[75018]:       <log file='/opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3/console.log' append='off'/>
Nov 07 15:24:51 user nova-compute[75018]:       <target type='serial' port='0'/>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='serial0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </console>
Nov 07 15:24:51 user nova-compute[75018]:     <input type='mouse' bus='ps2'>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='input0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </input>
Nov 07 15:24:51 user nova-compute[75018]:     <input type='keyboard' bus='ps2'>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='input1'/>
Nov 07 15:24:51 user nova-compute[75018]:     </input>
Nov 07 15:24:51 user nova-compute[75018]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 07 15:24:51 user nova-compute[75018]:       <listen type='address' address='0.0.0.0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </graphics>
Nov 07 15:24:51 user nova-compute[75018]:     <audio id='1' type='none'/>
Nov 07 15:24:51 user nova-compute[75018]:     <video>
Nov 07 15:24:51 user nova-compute[75018]:       <model type='virtio' heads='1' primary='yes'/>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='video0'/>
Nov 07 15:24:51 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </video>
Nov 07 15:24:51 user nova-compute[75018]:     <memballoon model='virtio'>
Nov 07 15:24:51 user nova-compute[75018]:       <stats period='10'/>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='balloon0'/>
Nov 07 15:24:51 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </memballoon>
Nov 07 15:24:51 user nova-compute[75018]:     <rng model='virtio'>
Nov 07 15:24:51 user nova-compute[75018]:       <backend model='random'>/dev/urandom</backend>
Nov 07 15:24:51 user nova-compute[75018]:       <alias name='rng0'/>
Nov 07 15:24:51 user nova-compute[75018]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 07 15:24:51 user nova-compute[75018]:     </rng>
Nov 07 15:24:51 user nova-compute[75018]:   </devices>
Nov 07 15:24:51 user nova-compute[75018]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 07 15:24:51 user nova-compute[75018]:     <label>libvirt-f9efb536-b47e-4e87-bc54-fdf69cacf8e3</label>
Nov 07 15:24:51 user nova-compute[75018]:     <imagelabel>libvirt-f9efb536-b47e-4e87-bc54-fdf69cacf8e3</imagelabel>
Nov 07 15:24:51 user nova-compute[75018]:   </seclabel>
Nov 07 15:24:51 user nova-compute[75018]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 07 15:24:51 user nova-compute[75018]:     <label>+64055:+108</label>
Nov 07 15:24:51 user nova-compute[75018]:     <imagelabel>+64055:+108</imagelabel>
Nov 07 15:24:51 user nova-compute[75018]:   </seclabel>
Nov 07 15:24:51 user nova-compute[75018]: </domain>
Nov 07 15:24:51 user nova-compute[75018]:  {{(pid=75018) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 07 15:24:51 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Detaching interface fa:16:3e:b8:5e:1e failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap59996421-4e' not found.
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1580286647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1580286647',id=6,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBa2umF2j3NFcrA/MMVfFX9CwszOvYSV953cPLJB8Fg9xF6mpuVYI1nrRM/8pACoITM+FQT+M6FG3/0v9UsQ2UUg5VLULbr4xVkSLj0F171iDoJzrj+ppTAogqlmzzug==',key_name='tempest-keypair-464082042',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:21:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c9868af5b9d4666b842470b30e169d2',ramdisk_id='',reservation_id='r-tw13f7f8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2013364869',owner_user_name='tempest-TaggedAttachmentsTest-2013364869-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:21:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd118649a4241bb95956240a2393048',uuid=f9efb536-b47e-4e87-bc54-fdf69cacf8e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59996421-4eca-48d7-a613-1e938d23fc17", "address": "fa:16:3e:b8:5e:1e", "network": {"id": "8b16abf0-67a0-46d6-b688-5059b2dd37e9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1556414992", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59996421-4e", "ovs_interfaceid": "59996421-4eca-48d7-a613-1e938d23fc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.network.os_vif_util [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] Converting VIF {"id": "59996421-4eca-48d7-a613-1e938d23fc17", "address": "fa:16:3e:b8:5e:1e", "network": {"id": "8b16abf0-67a0-46d6-b688-5059b2dd37e9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1556414992", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59996421-4e", "ovs_interfaceid": "59996421-4eca-48d7-a613-1e938d23fc17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.network.os_vif_util [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:1e,bridge_name='br-int',has_traffic_filtering=True,id=59996421-4eca-48d7-a613-1e938d23fc17,network=Network(8b16abf0-67a0-46d6-b688-5059b2dd37e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59996421-4e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG os_vif [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:1e,bridge_name='br-int',has_traffic_filtering=True,id=59996421-4eca-48d7-a613-1e938d23fc17,network=Network(8b16abf0-67a0-46d6-b688-5059b2dd37e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59996421-4e') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59996421-4e, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:24:51 user nova-compute[75018]: INFO os_vif [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:1e,bridge_name='br-int',has_traffic_filtering=True,id=59996421-4eca-48d7-a613-1e938d23fc17,network=Network(8b16abf0-67a0-46d6-b688-5059b2dd37e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59996421-4e')
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [req-0d632436-6f13-470b-924f-b3622a7fd0ba req-40dc06c5-adeb-477a-b337-fdd29fe8fac2 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:24:51 user nova-compute[75018]:   <nova:package version="0.0.0"/>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:name>tempest-device-tagging-server-1580286647</nova:name>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:creationTime>2023-11-07 15:24:51</nova:creationTime>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:flavor name="m1.tiny">
Nov 07 15:24:51 user nova-compute[75018]:     <nova:memory>512</nova:memory>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:disk>1</nova:disk>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:swap>0</nova:swap>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:vcpus>1</nova:vcpus>
Nov 07 15:24:51 user nova-compute[75018]:   </nova:flavor>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:owner>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:user uuid="8dd118649a4241bb95956240a2393048">tempest-TaggedAttachmentsTest-2013364869-project-member</nova:user>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:project uuid="5c9868af5b9d4666b842470b30e169d2">tempest-TaggedAttachmentsTest-2013364869</nova:project>
Nov 07 15:24:51 user nova-compute[75018]:   </nova:owner>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:24:51 user nova-compute[75018]:   <nova:ports>
Nov 07 15:24:51 user nova-compute[75018]:     <nova:port uuid="5b3da5d6-6cee-4668-b7cd-5d328309eca6">
Nov 07 15:24:51 user nova-compute[75018]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 07 15:24:51 user nova-compute[75018]:     </nova:port>
Nov 07 15:24:51 user nova-compute[75018]:   </nova:ports>
Nov 07 15:24:51 user nova-compute[75018]: </nova:instance>
Nov 07 15:24:51 user nova-compute[75018]:  {{(pid=75018) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Updating instance_info_cache with network_info: [{"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Releasing lock "refresh_cache-f9efb536-b47e-4e87-bc54-fdf69cacf8e3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:24:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e60ef16-e266-42af-894e-e8c3d4dd194b tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "interface-f9efb536-b47e-4e87-bc54-fdf69cacf8e3-59996421-4eca-48d7-a613-1e938d23fc17" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.681s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Stashing vm_state: active {{(pid=75018) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 07 15:24:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:53 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:24:53 user nova-compute[75018]: INFO nova.compute.claims [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Claim successful on node user
Nov 07 15:24:53 user nova-compute[75018]: INFO nova.compute.resource_tracker [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating resource usage from migration 07c5ca07-6454-457d-b35f-9fa944179505
Nov 07 15:24:53 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:24:53 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:24:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.372s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:53 user nova-compute[75018]: INFO nova.compute.manager [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Migrating
Nov 07 15:24:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:24:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:24:53 user nova-compute[75018]: INFO nova.compute.rpcapi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 07 15:24:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:24:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:24:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquired lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:24:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:24:54 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating instance_info_cache with network_info: [{"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:24:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Releasing lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:24:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Starting migrate_disk_and_power_off {{(pid=75018) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 07 15:24:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:54 user nova-compute[75018]: DEBUG nova.compute.manager [req-04f8277a-5363-4d5a-8dbd-8cc5cee533b7 req-320b766d-f5e2-45df-b65a-ae508c3e6cc2 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-vif-unplugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-04f8277a-5363-4d5a-8dbd-8cc5cee533b7 req-320b766d-f5e2-45df-b65a-ae508c3e6cc2 service nova] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-04f8277a-5363-4d5a-8dbd-8cc5cee533b7 req-320b766d-f5e2-45df-b65a-ae508c3e6cc2 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-04f8277a-5363-4d5a-8dbd-8cc5cee533b7 req-320b766d-f5e2-45df-b65a-ae508c3e6cc2 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:54 user nova-compute[75018]: DEBUG nova.compute.manager [req-04f8277a-5363-4d5a-8dbd-8cc5cee533b7 req-320b766d-f5e2-45df-b65a-ae508c3e6cc2 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] No waiting events found dispatching network-vif-unplugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:54 user nova-compute[75018]: WARNING nova.compute.manager [req-04f8277a-5363-4d5a-8dbd-8cc5cee533b7 req-320b766d-f5e2-45df-b65a-ae508c3e6cc2 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received unexpected event network-vif-unplugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 for instance with vm_state active and task_state resize_migrating.
Nov 07 15:24:55 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Instance destroyed successfully.
Nov 07 15:24:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077045494',display_name='tempest-ServerActionsTestOtherB-server-2077045494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077045494',id=1,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyBOTPm1HGMtOU1eTQJ9qDH8GeBUu2t+LNMgZBFFRP6tXXqDAukKUUiPODmfxQ+bXcX5mB9tkmMwlkDaHeyRpZSXxAXFTca2PcoYOgGrbYpszpri/wTQI3HjvvfuDY7fQ==',key_name='tempest-keypair-1660361084',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:20:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='585cee0db41e41dda7f10ecfc90f1daf',ramdisk_id='',reservation_id='r-rh7e0y4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1343289164',owner_user_name='tempest-ServerActionsTestOtherB-1343289164-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:24:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b867fc1e0742c3a3c5b76ed6fb756e',uuid=8257c590-204a-4fde-8487-79b8c0c87ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-370627506-network", "vif_mac": "fa:16:3e:a6:52:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converting VIF {"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-370627506-network", "vif_mac": "fa:16:3e:a6:52:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_vif [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05429ce8-06, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dacdea2f-d9ff-4487-96fe-06b65d8d2954) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:55 user nova-compute[75018]: INFO os_vif [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06')
Nov 07 15:24:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUpZxbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:55 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e801e8fa-0641-40b8-88ac-09ec85690313]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:24:55 user nova-compute[75018]: No targets found.
Nov 07 15:24:55 user nova-compute[75018]: iSNS:
Nov 07 15:24:55 user nova-compute[75018]: No targets found.
Nov 07 15:24:55 user nova-compute[75018]: STATIC:
Nov 07 15:24:55 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3
Nov 07 15:24:55 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:55 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:55 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042
Nov 07 15:24:55 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:55 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:55 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1
Nov 07 15:24:55 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:55 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:55 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a
Nov 07 15:24:55 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:55 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:55 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867
Nov 07 15:24:55 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:55 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:55 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:24:55 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:55 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:55 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6
Nov 07 15:24:55 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:55 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:55 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf
Nov 07 15:24:55 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:24:55 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:24:55 user nova-compute[75018]: FIRMWARE:
Nov 07 15:24:55 user nova-compute[75018]: No targets found.
Nov 07 15:24:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:24:55 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:24:55 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6a1a38-7879-4f11-927f-cfff09c0f83a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2f0f1f-4c8a-4f87-8614-ab6e4134801c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:55 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:55 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:55 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:55 user nova-compute[75018]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:24:55 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:55 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:55 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:24:55 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:24:55 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:24:55 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:24:55 user nova-compute[75018]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:24:55 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:24:55 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:24:55 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:24:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae06e2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf'): ({'sdc'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Removing single pathed devices sdc {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c82e75-81a6-4ed8-bc7c-30316553a03c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a736241a-a231-44eb-b380-da02daac9752]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Flushing IO for device /dev/sdc {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa208176-1d1b-49d7-aa42-2450b20fdee7]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c45897-3f58-4990-bc0d-5be6da912b31]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e991a8a8-c48d-45ff-98c3-1a2b18427e77]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[465929cd-2601-4003-80b4-06c8d85cefc6]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260]
Nov 07 15:24:55 user nova-compute[75018]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260] successful.
Nov 07 15:24:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9019277-5841-4764-9f58-f0d352d7d6bc]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] <== disconnect_volume: return (336ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:24:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7_resize/disk /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "cp -r /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7_resize/disk /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk" returned: 0 in 0.371s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7_resize/disk.info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk.info {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "cp -r /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7_resize/disk.info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk.info" returned: 0 in 0.035s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-f26e072d-d85f-463a-822c-7f6f2bfa9f3d req-085eb807-9f57-47c1-963b-52db45a1ec6b service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:24:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f26e072d-d85f-463a-822c-7f6f2bfa9f3d req-085eb807-9f57-47c1-963b-52db45a1ec6b service nova] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f26e072d-d85f-463a-822c-7f6f2bfa9f3d req-085eb807-9f57-47c1-963b-52db45a1ec6b service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f26e072d-d85f-463a-822c-7f6f2bfa9f3d req-085eb807-9f57-47c1-963b-52db45a1ec6b service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-f26e072d-d85f-463a-822c-7f6f2bfa9f3d req-085eb807-9f57-47c1-963b-52db45a1ec6b service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] No waiting events found dispatching network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:24:57 user nova-compute[75018]: WARNING nova.compute.manager [req-f26e072d-d85f-463a-822c-7f6f2bfa9f3d req-085eb807-9f57-47c1-963b-52db45a1ec6b service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received unexpected event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 for instance with vm_state active and task_state resize_migrating.
Nov 07 15:24:57 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Port 05429ce8-06b2-4693-bf2c-5d03a4343e00 binding to destination host user is already ACTIVE {{(pid=75018) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 07 15:24:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:24:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquired lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:24:58 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:24:58 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating instance_info_cache with network_info: [{"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:24:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Releasing lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG os_brick.utils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[585aaa26-68c4-4b2c-818f-4ef92ebcf32a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6ab253-d7b3-4337-b014-3825d742c3fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c525624-e27f-4440-805e-8e2458657296]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6364e47a-0f01-4705-8c69-4604af9e4ca8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:24:59 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d39f57-6831-4b50-8feb-bb6d435384ee]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG os_brick.utils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "a62fafee-cada-4958-9349-f7771893709f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "a62fafee-cada-4958-9349-f7771893709f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:24:59 user nova-compute[75018]: INFO nova.compute.claims [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Claim successful on node user
Nov 07 15:24:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:24:59 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:25:00 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:25:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG nova.policy [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d4b199a80014b9e8b931ee04376c693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fbe1a7764e40a3ba9fc1f02c183b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:25:00 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Creating image(s)
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "/opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "/opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "/opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Successfully created port: 75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk 1073741824" returned: 0 in 0.074s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.202s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:25:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Cannot resize image /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Ensure instance console log exists: /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Successfully updated port: 75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "refresh_cache-a62fafee-cada-4958-9349-f7771893709f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquired lock "refresh_cache-a62fafee-cada-4958-9349-f7771893709f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-30da2273-c320-46d0-bc0b-2c5a9bd8a135 req-37ae70d0-ba3b-4c6f-8e84-461c182c5572 service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] Received event network-changed-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-30da2273-c320-46d0-bc0b-2c5a9bd8a135 req-37ae70d0-ba3b-4c6f-8e84-461c182c5572 service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] Refreshing instance network info cache due to event network-changed-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-30da2273-c320-46d0-bc0b-2c5a9bd8a135 req-37ae70d0-ba3b-4c6f-8e84-461c182c5572 service nova] Acquiring lock "refresh_cache-a62fafee-cada-4958-9349-f7771893709f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Updating instance_info_cache with network_info: [{"id": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "address": "fa:16:3e:19:16:9a", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a2b6e3-8d", "ovs_interfaceid": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Releasing lock "refresh_cache-a62fafee-cada-4958-9349-f7771893709f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Instance network_info: |[{"id": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "address": "fa:16:3e:19:16:9a", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a2b6e3-8d", "ovs_interfaceid": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-30da2273-c320-46d0-bc0b-2c5a9bd8a135 req-37ae70d0-ba3b-4c6f-8e84-461c182c5572 service nova] Acquired lock "refresh_cache-a62fafee-cada-4958-9349-f7771893709f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.network.neutron [req-30da2273-c320-46d0-bc0b-2c5a9bd8a135 req-37ae70d0-ba3b-4c6f-8e84-461c182c5572 service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] Refreshing network info cache for port 75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Start _get_guest_xml network_info=[{"id": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "address": "fa:16:3e:19:16:9a", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a2b6e3-8d", "ovs_interfaceid": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:25:01 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:25:01 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-930712938',display_name='tempest-VolumesAdminNegativeTest-server-930712938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-930712938',id=14,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27fbe1a7764e40a3ba9fc1f02c183b50',ramdisk_id='',reservation_id='r-g8eys4a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-617339332',owner_user_name='tempest-VolumesAdminNegativeTest-617339332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:25:00Z,user_data=None,user_id='7d4b199a80014b9e8b931ee04376c693',uuid=a62fafee-cada-4958-9349-f7771893709f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "address": "fa:16:3e:19:16:9a", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a2b6e3-8d", "ovs_interfaceid": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Converting VIF {"id": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "address": "fa:16:3e:19:16:9a", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a2b6e3-8d", "ovs_interfaceid": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:16:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8,network=Network(fc935020-27d6-4ac8-9e8e-6fa65590da1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a2b6e3-8d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.objects.instance [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lazy-loading 'pci_devices' on Instance uuid a62fafee-cada-4958-9349-f7771893709f {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:25:01 user nova-compute[75018]:   <uuid>a62fafee-cada-4958-9349-f7771893709f</uuid>
Nov 07 15:25:01 user nova-compute[75018]:   <name>instance-0000000e</name>
Nov 07 15:25:01 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:25:01 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:25:01 user nova-compute[75018]:   <metadata>
Nov 07 15:25:01 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:25:01 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:25:01 user nova-compute[75018]:       <nova:name>tempest-VolumesAdminNegativeTest-server-930712938</nova:name>
Nov 07 15:25:01 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:25:01</nova:creationTime>
Nov 07 15:25:01 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:25:01 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:25:01 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:25:01 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:25:01 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:25:01 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:25:01 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:25:01 user nova-compute[75018]:       <nova:owner>
Nov 07 15:25:01 user nova-compute[75018]:         <nova:user uuid="7d4b199a80014b9e8b931ee04376c693">tempest-VolumesAdminNegativeTest-617339332-project-member</nova:user>
Nov 07 15:25:01 user nova-compute[75018]:         <nova:project uuid="27fbe1a7764e40a3ba9fc1f02c183b50">tempest-VolumesAdminNegativeTest-617339332</nova:project>
Nov 07 15:25:01 user nova-compute[75018]:       </nova:owner>
Nov 07 15:25:01 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:25:01 user nova-compute[75018]:       <nova:ports>
Nov 07 15:25:01 user nova-compute[75018]:         <nova:port uuid="75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8">
Nov 07 15:25:01 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 07 15:25:01 user nova-compute[75018]:         </nova:port>
Nov 07 15:25:01 user nova-compute[75018]:       </nova:ports>
Nov 07 15:25:01 user nova-compute[75018]:     </nova:instance>
Nov 07 15:25:01 user nova-compute[75018]:   </metadata>
Nov 07 15:25:01 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:25:01 user nova-compute[75018]:     <system>
Nov 07 15:25:01 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:25:01 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:25:01 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:25:01 user nova-compute[75018]:       <entry name="serial">a62fafee-cada-4958-9349-f7771893709f</entry>
Nov 07 15:25:01 user nova-compute[75018]:       <entry name="uuid">a62fafee-cada-4958-9349-f7771893709f</entry>
Nov 07 15:25:01 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:25:01 user nova-compute[75018]:     </system>
Nov 07 15:25:01 user nova-compute[75018]:   </sysinfo>
Nov 07 15:25:01 user nova-compute[75018]:   <os>
Nov 07 15:25:01 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:25:01 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:25:01 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:25:01 user nova-compute[75018]:   </os>
Nov 07 15:25:01 user nova-compute[75018]:   <features>
Nov 07 15:25:01 user nova-compute[75018]:     <acpi/>
Nov 07 15:25:01 user nova-compute[75018]:     <apic/>
Nov 07 15:25:01 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:25:01 user nova-compute[75018]:   </features>
Nov 07 15:25:01 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:25:01 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:25:01 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:25:01 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:25:01 user nova-compute[75018]:   </clock>
Nov 07 15:25:01 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:25:01 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:25:01 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:25:01 user nova-compute[75018]:   </cpu>
Nov 07 15:25:01 user nova-compute[75018]:   <devices>
Nov 07 15:25:01 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:25:01 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:25:01 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk"/>
Nov 07 15:25:01 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:25:01 user nova-compute[75018]:     </disk>
Nov 07 15:25:01 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:25:01 user nova-compute[75018]:       <mac address="fa:16:3e:19:16:9a"/>
Nov 07 15:25:01 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:25:01 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:25:01 user nova-compute[75018]:       <target dev="tap75a2b6e3-8d"/>
Nov 07 15:25:01 user nova-compute[75018]:     </interface>
Nov 07 15:25:01 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:25:01 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/console.log" append="off"/>
Nov 07 15:25:01 user nova-compute[75018]:     </serial>
Nov 07 15:25:01 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:25:01 user nova-compute[75018]:     <video>
Nov 07 15:25:01 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:25:01 user nova-compute[75018]:     </video>
Nov 07 15:25:01 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:25:01 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:25:01 user nova-compute[75018]:     </rng>
Nov 07 15:25:01 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:25:01 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:25:01 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:25:01 user nova-compute[75018]:     </memballoon>
Nov 07 15:25:01 user nova-compute[75018]:   </devices>
Nov 07 15:25:01 user nova-compute[75018]: </domain>
Nov 07 15:25:01 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-930712938',display_name='tempest-VolumesAdminNegativeTest-server-930712938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-930712938',id=14,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27fbe1a7764e40a3ba9fc1f02c183b50',ramdisk_id='',reservation_id='r-g8eys4a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-617339332',owner_user_name='tempest-VolumesAdminNegativeTest-617339332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:25:00Z,user_data=None,user_id='7d4b199a80014b9e8b931ee04376c693',uuid=a62fafee-cada-4958-9349-f7771893709f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "address": "fa:16:3e:19:16:9a", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a2b6e3-8d", "ovs_interfaceid": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Converting VIF {"id": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "address": "fa:16:3e:19:16:9a", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a2b6e3-8d", "ovs_interfaceid": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:16:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8,network=Network(fc935020-27d6-4ac8-9e8e-6fa65590da1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a2b6e3-8d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG os_vif [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:16:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8,network=Network(fc935020-27d6-4ac8-9e8e-6fa65590da1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a2b6e3-8d') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a1ba3e0-26c2-5364-a130-ddcf7ccfa982', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75a2b6e3-8d, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75a2b6e3-8d, col_values=(('qos', UUID('a5b1b780-b762-49de-82be-9f200c2aa05b')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75a2b6e3-8d, col_values=(('external_ids', {'iface-id': '75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:16:9a', 'vm-uuid': 'a62fafee-cada-4958-9349-f7771893709f'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:01 user nova-compute[75018]: INFO os_vif [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:16:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8,network=Network(fc935020-27d6-4ac8-9e8e-6fa65590da1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a2b6e3-8d')
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] No VIF found with MAC fa:16:3e:19:16:9a, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.network.neutron [req-30da2273-c320-46d0-bc0b-2c5a9bd8a135 req-37ae70d0-ba3b-4c6f-8e84-461c182c5572 service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] Updated VIF entry in instance network info cache for port 75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:25:01 user nova-compute[75018]: DEBUG nova.network.neutron [req-30da2273-c320-46d0-bc0b-2c5a9bd8a135 req-37ae70d0-ba3b-4c6f-8e84-461c182c5572 service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] Updating instance_info_cache with network_info: [{"id": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "address": "fa:16:3e:19:16:9a", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a2b6e3-8d", "ovs_interfaceid": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:25:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-30da2273-c320-46d0-bc0b-2c5a9bd8a135 req-37ae70d0-ba3b-4c6f-8e84-461c182c5572 service nova] Releasing lock "refresh_cache-a62fafee-cada-4958-9349-f7771893709f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:25:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-37ade329-6788-4c7c-83c0-ee319848bcba req-c778e190-5d34-4f45-ab4f-b53235bc61ea service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] Received event network-vif-plugged-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-37ade329-6788-4c7c-83c0-ee319848bcba req-c778e190-5d34-4f45-ab4f-b53235bc61ea service nova] Acquiring lock "a62fafee-cada-4958-9349-f7771893709f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-37ade329-6788-4c7c-83c0-ee319848bcba req-c778e190-5d34-4f45-ab4f-b53235bc61ea service nova] Lock "a62fafee-cada-4958-9349-f7771893709f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-37ade329-6788-4c7c-83c0-ee319848bcba req-c778e190-5d34-4f45-ab4f-b53235bc61ea service nova] Lock "a62fafee-cada-4958-9349-f7771893709f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-37ade329-6788-4c7c-83c0-ee319848bcba req-c778e190-5d34-4f45-ab4f-b53235bc61ea service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] No waiting events found dispatching network-vif-plugged-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:25:03 user nova-compute[75018]: WARNING nova.compute.manager [req-37ade329-6788-4c7c-83c0-ee319848bcba req-c778e190-5d34-4f45-ab4f-b53235bc61ea service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] Received unexpected event network-vif-plugged-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 for instance with vm_state building and task_state spawning.
Nov 07 15:25:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:05 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:25:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:25:05 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: a62fafee-cada-4958-9349-f7771893709f] Instance spawned successfully.
Nov 07 15:25:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:25:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:25:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:25:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:25:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:25:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:25:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:25:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-b4422a3f-6a66-4ada-b37c-9eb3d5d4ec6a req-ddcdda15-0966-404f-bf5f-dc51bf9dd1fe service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] Received event network-vif-plugged-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b4422a3f-6a66-4ada-b37c-9eb3d5d4ec6a req-ddcdda15-0966-404f-bf5f-dc51bf9dd1fe service nova] Acquiring lock "a62fafee-cada-4958-9349-f7771893709f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b4422a3f-6a66-4ada-b37c-9eb3d5d4ec6a req-ddcdda15-0966-404f-bf5f-dc51bf9dd1fe service nova] Lock "a62fafee-cada-4958-9349-f7771893709f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b4422a3f-6a66-4ada-b37c-9eb3d5d4ec6a req-ddcdda15-0966-404f-bf5f-dc51bf9dd1fe service nova] Lock "a62fafee-cada-4958-9349-f7771893709f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-b4422a3f-6a66-4ada-b37c-9eb3d5d4ec6a req-ddcdda15-0966-404f-bf5f-dc51bf9dd1fe service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] No waiting events found dispatching network-vif-plugged-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:25:05 user nova-compute[75018]: WARNING nova.compute.manager [req-b4422a3f-6a66-4ada-b37c-9eb3d5d4ec6a req-ddcdda15-0966-404f-bf5f-dc51bf9dd1fe service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] Received unexpected event network-vif-plugged-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 for instance with vm_state building and task_state spawning.
Nov 07 15:25:05 user nova-compute[75018]: INFO nova.compute.manager [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 07 15:25:05 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:25:05 user nova-compute[75018]: INFO nova.compute.manager [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Took 6.23 seconds to build instance.
Nov 07 15:25:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f857af42-5e0b-4059-a405-5b405f606ade tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "a62fafee-cada-4958-9349-f7771893709f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.341s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:25:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:25:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:25:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:25:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:25:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:17 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'pci_requests' on Instance uuid eb712362-b6b8-4a19-8f5b-8c374d6c4d87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:25:17 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'numa_topology' on Instance uuid eb712362-b6b8-4a19-8f5b-8c374d6c4d87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:25:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:25:17 user nova-compute[75018]: INFO nova.compute.claims [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Claim successful on node user
Nov 07 15:25:18 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:25:18 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:25:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:18 user nova-compute[75018]: INFO nova.network.neutron [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updating port d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquired lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG nova.network.neutron [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG nova.compute.manager [req-8acc6c3d-62d2-46ad-8b28-25466ebac6ba req-c66378b9-82c7-44ef-983b-6df3159b9834 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received event network-changed-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG nova.compute.manager [req-8acc6c3d-62d2-46ad-8b28-25466ebac6ba req-c66378b9-82c7-44ef-983b-6df3159b9834 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Refreshing instance network info cache due to event network-changed-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8acc6c3d-62d2-46ad-8b28-25466ebac6ba req-c66378b9-82c7-44ef-983b-6df3159b9834 service nova] Acquiring lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG nova.network.neutron [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updating instance_info_cache with network_info: [{"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Releasing lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:25:19 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Creating image(s)
Nov 07 15:25:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "/opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "/opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'trusted_certs' on Instance uuid eb712362-b6b8-4a19-8f5b-8c374d6c4d87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8acc6c3d-62d2-46ad-8b28-25466ebac6ba req-c66378b9-82c7-44ef-983b-6df3159b9834 service nova] Acquired lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG nova.network.neutron [req-8acc6c3d-62d2-46ad-8b28-25466ebac6ba req-c66378b9-82c7-44ef-983b-6df3159b9834 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Refreshing network info cache for port d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG nova.objects.base [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Object Instance<eb712362-b6b8-4a19-8f5b-8c374d6c4d87> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "bb5561fee7baa1b3e9e81addb727cf3eedb56a8f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "bb5561fee7baa1b3e9e81addb727cf3eedb56a8f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f.part --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:20 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:25:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:20 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:25:20 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:25:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f.part --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:20 user nova-compute[75018]: DEBUG nova.virt.images [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] e3625d1e-ba61-4243-a5ea-0e8012f23bdd was qcow2, converting to raw {{(pid=75018) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 15:25:20 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:25:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f.part /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f.converted {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:20 user nova-compute[75018]: DEBUG nova.network.neutron [req-8acc6c3d-62d2-46ad-8b28-25466ebac6ba req-c66378b9-82c7-44ef-983b-6df3159b9834 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updated VIF entry in instance network info cache for port d7fccd97-1db7-4dac-b2e9-6d5b4004aa70. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:25:20 user nova-compute[75018]: DEBUG nova.network.neutron [req-8acc6c3d-62d2-46ad-8b28-25466ebac6ba req-c66378b9-82c7-44ef-983b-6df3159b9834 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updating instance_info_cache with network_info: [{"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:25:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8acc6c3d-62d2-46ad-8b28-25466ebac6ba req-c66378b9-82c7-44ef-983b-6df3159b9834 service nova] Releasing lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:21 user nova-compute[75018]: INFO nova.compute.manager [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Terminating instance
Nov 07 15:25:21 user nova-compute[75018]: DEBUG nova.compute.manager [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f.part /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f.converted" returned: 0 in 0.589s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f.converted --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "bb5561fee7baa1b3e9e81addb727cf3eedb56a8f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.073s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG nova.compute.manager [req-acb70818-bd63-4d62-8fb6-30f41597007a req-01f6f136-8aeb-416b-9746-7de10818877f service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received event network-vif-unplugged-5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-acb70818-bd63-4d62-8fb6-30f41597007a req-01f6f136-8aeb-416b-9746-7de10818877f service nova] Acquiring lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-acb70818-bd63-4d62-8fb6-30f41597007a req-01f6f136-8aeb-416b-9746-7de10818877f service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-acb70818-bd63-4d62-8fb6-30f41597007a req-01f6f136-8aeb-416b-9746-7de10818877f service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG nova.compute.manager [req-acb70818-bd63-4d62-8fb6-30f41597007a req-01f6f136-8aeb-416b-9746-7de10818877f service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] No waiting events found dispatching network-vif-unplugged-5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG nova.compute.manager [req-acb70818-bd63-4d62-8fb6-30f41597007a req-01f6f136-8aeb-416b-9746-7de10818877f service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received event network-vif-unplugged-5b3da5d6-6cee-4668-b7cd-5d328309eca6 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:25:21 user nova-compute[75018]: WARNING nova.compute.manager [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Timeout waiting for ['volume-reimaged-cd6809db-5bfd-4f25-a699-665747ec0582'] for instance with vm_state active and task_state rebuilding. Event states are: volume-reimaged-cd6809db-5bfd-4f25-a699-665747ec0582: timed out after 60.00 seconds: eventlet.timeout.Timeout: 60 seconds
Nov 07 15:25:21 user nova-compute[75018]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py:180: UserWarning: Cannot convert <Timeout at 0x7feae06f3820 seconds=60> to primitive, will raise ValueError instead of warning in version 3.0
Nov 07 15:25:21 user nova-compute[75018]:   warnings.warn("Cannot convert %r to primitive, will raise ValueError "
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f --force-share --output=json" returned: 0 in 0.210s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "bb5561fee7baa1b3e9e81addb727cf3eedb56a8f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "bb5561fee7baa1b3e9e81addb727cf3eedb56a8f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:21 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Instance destroyed successfully.
Nov 07 15:25:21 user nova-compute[75018]: DEBUG nova.objects.instance [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lazy-loading 'resources' on Instance uuid f9efb536-b47e-4e87-bc54-fdf69cacf8e3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1580286647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1580286647',id=6,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBa2umF2j3NFcrA/MMVfFX9CwszOvYSV953cPLJB8Fg9xF6mpuVYI1nrRM/8pACoITM+FQT+M6FG3/0v9UsQ2UUg5VLULbr4xVkSLj0F171iDoJzrj+ppTAogqlmzzug==',key_name='tempest-keypair-464082042',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:21:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c9868af5b9d4666b842470b30e169d2',ramdisk_id='',reservation_id='r-tw13f7f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2013364869',owner_user_name='tempest-TaggedAttachmentsTest-2013364869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:21:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd118649a4241bb95956240a2393048',uuid=f9efb536-b47e-4e87-bc54-fdf69cacf8e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Converting VIF {"id": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "address": "fa:16:3e:e1:55:2d", "network": {"id": "1a48b985-929f-4749-a055-0c7c9f5d14db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-571858437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9868af5b9d4666b842470b30e169d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3da5d6-6c", "ovs_interfaceid": "5b3da5d6-6cee-4668-b7cd-5d328309eca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:55:2d,bridge_name='br-int',has_traffic_filtering=True,id=5b3da5d6-6cee-4668-b7cd-5d328309eca6,network=Network(1a48b985-929f-4749-a055-0c7c9f5d14db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b3da5d6-6c') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG os_vif [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:55:2d,bridge_name='br-int',has_traffic_filtering=True,id=5b3da5d6-6cee-4668-b7cd-5d328309eca6,network=Network(1a48b985-929f-4749-a055-0c7c9f5d14db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b3da5d6-6c') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b3da5d6-6c, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2526cd3c-3e8e-40d8-8fe5-feb6b7a77108) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:21 user nova-compute[75018]: INFO os_vif [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:55:2d,bridge_name='br-int',has_traffic_filtering=True,id=5b3da5d6-6cee-4668-b7cd-5d328309eca6,network=Network(1a48b985-929f-4749-a055-0c7c9f5d14db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b3da5d6-6c')
Nov 07 15:25:21 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Deleting instance files /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3_del
Nov 07 15:25:21 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Deletion of /opt/stack/data/nova/instances/f9efb536-b47e-4e87-bc54-fdf69cacf8e3_del complete
Nov 07 15:25:22 user nova-compute[75018]: INFO nova.compute.manager [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f --force-share --output=json" returned: 0 in 0.240s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f,backing_fmt=raw /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f,backing_fmt=raw /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk 1073741824" returned: 0 in 0.065s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "bb5561fee7baa1b3e9e81addb727cf3eedb56a8f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'migration_context' on Instance uuid eb712362-b6b8-4a19-8f5b-8c374d6c4d87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG nova.objects.base [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Object Instance<eb712362-b6b8-4a19-8f5b-8c374d6c4d87> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:25:22 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Rebasing disk image.
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.700s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:22 user nova-compute[75018]: INFO nova.compute.manager [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Successfully reverted task state from rebuilding on failure for instance.
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server [None req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Exception during message handling: ValueError: Circular reference detected
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3713, in _rebuild_default_impl
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self._rebuild_volume_backed_instance(
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3633, in _rebuild_volume_backed_instance
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     with self.virtapi.wait_for_instance_event(instance, events,
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     next(self.gen)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 559, in wait_for_instance_event
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self._wait_for_instance_events(
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 471, in _wait_for_instance_events
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     actual_event = event.wait()
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 436, in wait
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     instance_event = self.event.wait()
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 125, in wait
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     result = hub.switch()
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 313, in switch
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return self.greenlet.switch()
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server eventlet.timeout.Timeout: 60 seconds
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server 
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server 
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1437, in decorated_function
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     with EventReporter(context, event_name, host, instance_uuid,
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1400, in __exit__
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     objects.InstanceActionEvent.event_finish_with_failure(
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/objects/base.py", line 393, in wrapper
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return fn.__get__(None, obj)(*args, **kwargs)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     result = cls.indirection_api.object_class_action_versions(
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return cctxt.call(context, 'object_class_action_versions',
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 190, in call
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     result = self.transport._send(
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 644, in _send
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     msg = rpc_common.serialize_msg(msg)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 292, in serialize_msg
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     _MESSAGE_KEY: jsonutils.dumps(raw_msg)}
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py", line 202, in dumps
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return json.dumps(obj, default=default, **kwargs)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/__init__.py", line 238, in dumps
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     **kw).encode(obj)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 199, in encode
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     chunks = self.iterencode(o, _one_shot=True)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 257, in iterencode
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server     return _iterencode(o, 0)
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server ValueError: Circular reference detected
Nov 07 15:25:22 user nova-compute[75018]: ERROR oslo_messaging.rpc.server 
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.236s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e -F raw /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:25:22 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Took 0.85 seconds to deallocate network for instance.
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:23 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Error from libvirt while getting description of instance-00000006: [Error Code 42] Domain not found: no domain with matching uuid 'f9efb536-b47e-4e87-bc54-fdf69cacf8e3' (instance-00000006): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f9efb536-b47e-4e87-bc54-fdf69cacf8e3' (instance-00000006)
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG nova.compute.manager [req-1130ce91-9ebd-4a0b-aed0-e9edb547e6af req-c76b4e43-0fdd-45a1-88ae-6228e3e750f7 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received event network-vif-plugged-5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1130ce91-9ebd-4a0b-aed0-e9edb547e6af req-c76b4e43-0fdd-45a1-88ae-6228e3e750f7 service nova] Acquiring lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1130ce91-9ebd-4a0b-aed0-e9edb547e6af req-c76b4e43-0fdd-45a1-88ae-6228e3e750f7 service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1130ce91-9ebd-4a0b-aed0-e9edb547e6af req-c76b4e43-0fdd-45a1-88ae-6228e3e750f7 service nova] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG nova.compute.manager [req-1130ce91-9ebd-4a0b-aed0-e9edb547e6af req-c76b4e43-0fdd-45a1-88ae-6228e3e750f7 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] No waiting events found dispatching network-vif-plugged-5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:25:23 user nova-compute[75018]: WARNING nova.compute.manager [req-1130ce91-9ebd-4a0b-aed0-e9edb547e6af req-c76b4e43-0fdd-45a1-88ae-6228e3e750f7 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received unexpected event network-vif-plugged-5b3da5d6-6cee-4668-b7cd-5d328309eca6 for instance with vm_state deleted and task_state None.
Nov 07 15:25:23 user nova-compute[75018]: DEBUG nova.compute.manager [req-1130ce91-9ebd-4a0b-aed0-e9edb547e6af req-c76b4e43-0fdd-45a1-88ae-6228e3e750f7 service nova] [instance: f9efb536-b47e-4e87-bc54-fdf69cacf8e3] Received event network-vif-deleted-5b3da5d6-6cee-4668-b7cd-5d328309eca6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.750s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:23 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Deleted allocations for instance f9efb536-b47e-4e87-bc54-fdf69cacf8e3
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-97580512-3612-4f9d-925f-8ea5e78cd24c tempest-TaggedAttachmentsTest-2013364869 tempest-TaggedAttachmentsTest-2013364869-project-member] Lock "f9efb536-b47e-4e87-bc54-fdf69cacf8e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.864s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.391s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:25:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk --force-share --output=json" returned: 0 in 0.826s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:25:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:25:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdl (vdc) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e -F raw /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk" returned: 0 in 4.242s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Ensure instance console log exists: /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Start _get_guest_xml network_info=[{"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='a1de2cf7fb18b8bfb853f238a962c845',container_format='bare',created_at=2023-11-07T15:22:25Z,direct_url=<?>,disk_format='qcow2',id=e3625d1e-ba61-4243-a5ea-0e8012f23bdd,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1081479971-shelved',owner='e1d8e2c039d94beea94f85d8d5a95d95',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-07T15:22:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKFozdfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'eb712362-b6b8-4a19-8f5b-8c374d6c4d87', 'attached_at': '', 'detached_at': '', 'volume_id': 'a827c6fb-5214-4b8c-ba79-b9b1923cc8f6', 'serial': 'a827c6fb-5214-4b8c-ba79-b9b1923cc8f6'}, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '5159e6b7-7f98-491c-8e53-b492be8dbef6', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:25:26 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:25:26 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7617MB free_disk=25.215042114257812GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:26 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:25:26 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a1de2cf7fb18b8bfb853f238a962c845',container_format='bare',created_at=2023-11-07T15:22:25Z,direct_url=<?>,disk_format='qcow2',id=e3625d1e-ba61-4243-a5ea-0e8012f23bdd,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1081479971-shelved',owner='e1d8e2c039d94beea94f85d8d5a95d95',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-07T15:22:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'vcpu_model' on Instance uuid eb712362-b6b8-4a19-8f5b-8c374d6c4d87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.objects.base [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Object Instance<eb712362-b6b8-4a19-8f5b-8c374d6c4d87> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKFozdfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:25:26 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:25:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:25:26 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:25:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:25:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:25:26 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Applying migration context for instance 8257c590-204a-4fde-8487-79b8c0c87ea7 as it has an incoming, in-progress migration 07c5ca07-6454-457d-b35f-9fa944179505. Migration status is post-migrating {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 07 15:25:27 user nova-compute[75018]: INFO nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating resource usage from migration 07c5ca07-6454-457d-b35f-9fa944179505
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260" returned: 21 in 0.083s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[252a92d6-51a9-4a3d-b27f-4b6281052a3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:25:27 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e22806-7914-4cf8-b476-900d29ecb0d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6] added
Nov 07 15:25:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e3abd70e-baf7-4f13-832c-43696a5ea80c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance d5341681-9ba6-4f21-a67c-00d50aea8762 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 5212605c-c913-483f-874b-17af335aeb2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 934e9b7f-8bb4-4487-83cd-c5fbc92daefc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 44f8bf0d-9714-45cf-8f71-206a8bb75a3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (54e83767-2936-4d0e-a90c-1dd381218079): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Migration 07c5ca07-6454-457d-b35f-9fa944179505 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8257c590-204a-4fde-8487-79b8c0c87ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance a62fafee-cada-4958-9349-f7771893709f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d761df64-673c-4d25-9fec-b62ef8461e5b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.050s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[176c24a0-05da-4836-a52e-ac85a747979a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKFozdfD {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKFozdfD" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bb83c6-a39e-44c2-9b46-819b23ec96d9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IKFozdfD'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4d97e3-0309-44df-95cc-1c5e002d66e8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[629ddfd1-fb70-4648-9924-2da0c03749a3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.171s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[487bcac5-8efe-4bdc-a74b-d09ae1c77d0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6, portal: 172.16.0.220,3260]
Nov 07 15:25:27 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6, portal: 172.16.0.220,3260] successful.
Nov 07 15:25:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.094s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf85384-8d73-48f4-bce5-886192cd1552]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[601eca49-bc61-4360-b562-212138c8b0b6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:25:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.601s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[591de302-155e-4ef7-a12a-8a0f61529fa3]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:25:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.823s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKFozdfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.631s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] <== connect_volume: return (1632ms) {'type': 'block', 'scsi_wwn': '23031623061343931', 'path': '/dev/sdd'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031623061343931', 'path': '/dev/sdd'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1081479971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1081479971',id=2,image_ref='e3625d1e-ba61-4243-a5ea-0e8012f23bdd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-376302873',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:20:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e1d8e2c039d94beea94f85d8d5a95d95',ramdisk_id='',reservation_id='r-hbv005jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-175335890',owner_user_name='tempest-AttachVolumeShelveTestJSON-175335890-project-member',shelved_at='2023-11-07T15:22:31.700428',shelved_host='user',shelved_image_id='e3625d1e-ba61-4243-a5ea-0e8012f23bdd'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:24:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c7596f1e0e748728fa459908f89aede',uuid=eb712362-b6b8-4a19-8f5b-8c374d6c4d87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converting VIF {"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d7fccd97-1db7-4dac-b2e9-6d5b4004aa70,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7fccd97-1d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'pci_devices' on Instance uuid eb712362-b6b8-4a19-8f5b-8c374d6c4d87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.objects.base [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Object Instance<eb712362-b6b8-4a19-8f5b-8c374d6c4d87> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:25:28 user nova-compute[75018]:   <uuid>eb712362-b6b8-4a19-8f5b-8c374d6c4d87</uuid>
Nov 07 15:25:28 user nova-compute[75018]:   <name>instance-00000002</name>
Nov 07 15:25:28 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:25:28 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:25:28 user nova-compute[75018]:   <metadata>
Nov 07 15:25:28 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:25:28 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:25:28 user nova-compute[75018]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1081479971</nova:name>
Nov 07 15:25:28 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:25:26</nova:creationTime>
Nov 07 15:25:28 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:25:28 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:25:28 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:25:28 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:25:28 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:25:28 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:25:28 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:25:28 user nova-compute[75018]:       <nova:owner>
Nov 07 15:25:28 user nova-compute[75018]:         <nova:user uuid="9c7596f1e0e748728fa459908f89aede">tempest-AttachVolumeShelveTestJSON-175335890-project-member</nova:user>
Nov 07 15:25:28 user nova-compute[75018]:         <nova:project uuid="e1d8e2c039d94beea94f85d8d5a95d95">tempest-AttachVolumeShelveTestJSON-175335890</nova:project>
Nov 07 15:25:28 user nova-compute[75018]:       </nova:owner>
Nov 07 15:25:28 user nova-compute[75018]:       <nova:root type="image" uuid="e3625d1e-ba61-4243-a5ea-0e8012f23bdd"/>
Nov 07 15:25:28 user nova-compute[75018]:       <nova:ports>
Nov 07 15:25:28 user nova-compute[75018]:         <nova:port uuid="d7fccd97-1db7-4dac-b2e9-6d5b4004aa70">
Nov 07 15:25:28 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 07 15:25:28 user nova-compute[75018]:         </nova:port>
Nov 07 15:25:28 user nova-compute[75018]:       </nova:ports>
Nov 07 15:25:28 user nova-compute[75018]:     </nova:instance>
Nov 07 15:25:28 user nova-compute[75018]:   </metadata>
Nov 07 15:25:28 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:25:28 user nova-compute[75018]:     <system>
Nov 07 15:25:28 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:25:28 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:25:28 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:25:28 user nova-compute[75018]:       <entry name="serial">eb712362-b6b8-4a19-8f5b-8c374d6c4d87</entry>
Nov 07 15:25:28 user nova-compute[75018]:       <entry name="uuid">eb712362-b6b8-4a19-8f5b-8c374d6c4d87</entry>
Nov 07 15:25:28 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:25:28 user nova-compute[75018]:     </system>
Nov 07 15:25:28 user nova-compute[75018]:   </sysinfo>
Nov 07 15:25:28 user nova-compute[75018]:   <os>
Nov 07 15:25:28 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:25:28 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:25:28 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:25:28 user nova-compute[75018]:   </os>
Nov 07 15:25:28 user nova-compute[75018]:   <features>
Nov 07 15:25:28 user nova-compute[75018]:     <acpi/>
Nov 07 15:25:28 user nova-compute[75018]:     <apic/>
Nov 07 15:25:28 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:25:28 user nova-compute[75018]:   </features>
Nov 07 15:25:28 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:25:28 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:25:28 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:25:28 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:25:28 user nova-compute[75018]:   </clock>
Nov 07 15:25:28 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:25:28 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:25:28 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:25:28 user nova-compute[75018]:   </cpu>
Nov 07 15:25:28 user nova-compute[75018]:   <devices>
Nov 07 15:25:28 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:25:28 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:25:28 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk"/>
Nov 07 15:25:28 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:25:28 user nova-compute[75018]:     </disk>
Nov 07 15:25:28 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:25:28 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:25:28 user nova-compute[75018]:       <source dev="/dev/sdd"/>
Nov 07 15:25:28 user nova-compute[75018]:       <target dev="vdc" bus="virtio"/>
Nov 07 15:25:28 user nova-compute[75018]:       <serial>a827c6fb-5214-4b8c-ba79-b9b1923cc8f6</serial>
Nov 07 15:25:28 user nova-compute[75018]:     </disk>
Nov 07 15:25:28 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:25:28 user nova-compute[75018]:       <mac address="fa:16:3e:be:3f:d4"/>
Nov 07 15:25:28 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:25:28 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:25:28 user nova-compute[75018]:       <target dev="tapd7fccd97-1d"/>
Nov 07 15:25:28 user nova-compute[75018]:     </interface>
Nov 07 15:25:28 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:25:28 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/console.log" append="off"/>
Nov 07 15:25:28 user nova-compute[75018]:     </serial>
Nov 07 15:25:28 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:25:28 user nova-compute[75018]:     <video>
Nov 07 15:25:28 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:25:28 user nova-compute[75018]:     </video>
Nov 07 15:25:28 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:25:28 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:25:28 user nova-compute[75018]:     </rng>
Nov 07 15:25:28 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:25:28 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:25:28 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:25:28 user nova-compute[75018]:     </memballoon>
Nov 07 15:25:28 user nova-compute[75018]:   </devices>
Nov 07 15:25:28 user nova-compute[75018]: </domain>
Nov 07 15:25:28 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1081479971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1081479971',id=2,image_ref='e3625d1e-ba61-4243-a5ea-0e8012f23bdd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-376302873',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:20:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e1d8e2c039d94beea94f85d8d5a95d95',ramdisk_id='',reservation_id='r-hbv005jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-175335890',owner_user_name='tempest-AttachVolumeShelveTestJSON-175335890-project-member',shelved_at='2023-11-07T15:22:31.700428',shelved_host='user',shelved_image_id='e3625d1e-ba61-4243-a5ea-0e8012f23bdd'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:24:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c7596f1e0e748728fa459908f89aede',uuid=eb712362-b6b8-4a19-8f5b-8c374d6c4d87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converting VIF {"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d7fccd97-1db7-4dac-b2e9-6d5b4004aa70,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7fccd97-1d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG os_vif [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d7fccd97-1db7-4dac-b2e9-6d5b4004aa70,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7fccd97-1d') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5103a24-3b25-5435-ad80-86da30217a57', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7fccd97-1d, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7fccd97-1d, col_values=(('qos', UUID('b1e29e22-592f-44f1-9a82-cd4765720d48')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7fccd97-1d, col_values=(('external_ids', {'iface-id': 'd7fccd97-1db7-4dac-b2e9-6d5b4004aa70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:3f:d4', 'vm-uuid': 'eb712362-b6b8-4a19-8f5b-8c374d6c4d87'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:28 user nova-compute[75018]: INFO os_vif [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d7fccd97-1db7-4dac-b2e9-6d5b4004aa70,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7fccd97-1d')
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] No VIF found with MAC fa:16:3e:be:3f:d4, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-e3abd70e-baf7-4f13-832c-43696a5ea80c" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-e3abd70e-baf7-4f13-832c-43696a5ea80c" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:25:28 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:25:29 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Updating instance_info_cache with network_info: [{"id": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "address": "fa:16:3e:0f:01:77", "network": {"id": "e5c35126-c724-438d-ac83-88c7304a8c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-84841748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beb79fc8bbc746178042b24a9019665c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd50d84f-cf", "ovs_interfaceid": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:25:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-e3abd70e-baf7-4f13-832c-43696a5ea80c" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:25:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:25:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:25:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:25:29 user nova-compute[75018]: DEBUG nova.compute.manager [req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e req-4d31232c-8fc6-4fe0-b6ce-789ae2935bc2 service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Received event volume-reimaged-cd6809db-5bfd-4f25-a699-665747ec0582 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e req-4d31232c-8fc6-4fe0-b6ce-789ae2935bc2 service nova] Acquiring lock "5212605c-c913-483f-874b-17af335aeb2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e req-4d31232c-8fc6-4fe0-b6ce-789ae2935bc2 service nova] Lock "5212605c-c913-483f-874b-17af335aeb2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e req-4d31232c-8fc6-4fe0-b6ce-789ae2935bc2 service nova] Lock "5212605c-c913-483f-874b-17af335aeb2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:29 user nova-compute[75018]: DEBUG nova.compute.manager [req-aba7a19e-400d-4be2-9e4b-5ddbd4ea138e req-4d31232c-8fc6-4fe0-b6ce-789ae2935bc2 service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Processing event volume-reimaged-cd6809db-5bfd-4f25-a699-665747ec0582 {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 07 15:25:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-1bc59f2c-65d4-47c8-a77f-217de6725a7a req-6395ac3c-383f-44c8-8a3f-8384e0a94aef service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received event network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1bc59f2c-65d4-47c8-a77f-217de6725a7a req-6395ac3c-383f-44c8-8a3f-8384e0a94aef service nova] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1bc59f2c-65d4-47c8-a77f-217de6725a7a req-6395ac3c-383f-44c8-8a3f-8384e0a94aef service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1bc59f2c-65d4-47c8-a77f-217de6725a7a req-6395ac3c-383f-44c8-8a3f-8384e0a94aef service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-1bc59f2c-65d4-47c8-a77f-217de6725a7a req-6395ac3c-383f-44c8-8a3f-8384e0a94aef service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] No waiting events found dispatching network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:25:30 user nova-compute[75018]: WARNING nova.compute.manager [req-1bc59f2c-65d4-47c8-a77f-217de6725a7a req-6395ac3c-383f-44c8-8a3f-8384e0a94aef service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received unexpected event network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 07 15:25:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-66087c6a-13d5-4721-8851-f4075d5048eb req-51dadf42-4b45-4e01-8c09-dbf36e8317ad service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received event network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-66087c6a-13d5-4721-8851-f4075d5048eb req-51dadf42-4b45-4e01-8c09-dbf36e8317ad service nova] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-66087c6a-13d5-4721-8851-f4075d5048eb req-51dadf42-4b45-4e01-8c09-dbf36e8317ad service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-66087c6a-13d5-4721-8851-f4075d5048eb req-51dadf42-4b45-4e01-8c09-dbf36e8317ad service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-66087c6a-13d5-4721-8851-f4075d5048eb req-51dadf42-4b45-4e01-8c09-dbf36e8317ad service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] No waiting events found dispatching network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:25:32 user nova-compute[75018]: WARNING nova.compute.manager [req-66087c6a-13d5-4721-8851-f4075d5048eb req-51dadf42-4b45-4e01-8c09-dbf36e8317ad service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received unexpected event network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 07 15:25:32 user nova-compute[75018]: DEBUG nova.compute.manager [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:25:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:25:32 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Instance spawned successfully.
Nov 07 15:25:33 user nova-compute[75018]: DEBUG nova.compute.manager [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:25:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3f2c9e02-ffa7-4b86-8c05-3a1db434ce86 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 74.974s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Starting finish_migration {{(pid=75018) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Instance directory exists: not creating {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 15:25:43 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Creating image(s)
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk. size=21474836480 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk 21474836480 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk 21474836480" returned: 0 in 0.055s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Did not create local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Ensure instance console log exists: /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Start _get_guest_xml network_info=[{"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-370627506-network", "vif_mac": "fa:16:3e:a6:52:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUpZxbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8257c590-204a-4fde-8487-79b8c0c87ea7', 'attached_at': '2023-11-07T15:25:43.000000', 'detached_at': '', 'volume_id': 'f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 'serial': 'f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'a9efc26f-fba8-4985-bc02-05f1b4bdc196', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:25:43 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:25:43 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUpZxbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:25:43 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:25:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:25:43 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:25:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:25:43 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e392df-5b18-41b1-b9c2-a0c5df023741]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:25:43 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9303ca-fc4b-4667-8aed-1987f7c87d72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf] added
Nov 07 15:25:43 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Acquiring lock "d5341681-9ba6-4f21-a67c-00d50aea8762" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Acquiring lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:43 user nova-compute[75018]: INFO nova.compute.manager [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Terminating instance
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfcb0a5-c792-47c2-895c-723f19df17ae]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7d200c-227c-4089-963e-8c1348091b65]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXUpZxbi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXUpZxbi" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bc9ed6-6d6c-4449-b954-70fa87ecd56e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lXUpZxbi'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12952fa-9955-4b1d-b613-8a8cfbf85ae2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2af51e4-2687-4d61-a0fe-89ad9abae05e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --login" returned: 0 in 0.130s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed3a8bb-0f9d-43dd-9c60-4dae4ccb9d3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260]
Nov 07 15:25:44 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260] successful.
Nov 07 15:25:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3d1c56-4685-453a-a5b2-6138b5c8d05c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a5187a-6f87-4543-bf46-2989345fea03]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:25:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.468s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebec24d-e88b-4724-a57e-81aeffdcb9b0]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUpZxbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-e4e65e49-b7d7-4f79-99bf-434bc19d7504 req-8c99f898-a7f0-42fd-9534-c3a050472ae2 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Received event network-vif-unplugged-9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e4e65e49-b7d7-4f79-99bf-434bc19d7504 req-8c99f898-a7f0-42fd-9534-c3a050472ae2 service nova] Acquiring lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e4e65e49-b7d7-4f79-99bf-434bc19d7504 req-8c99f898-a7f0-42fd-9534-c3a050472ae2 service nova] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e4e65e49-b7d7-4f79-99bf-434bc19d7504 req-8c99f898-a7f0-42fd-9534-c3a050472ae2 service nova] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-e4e65e49-b7d7-4f79-99bf-434bc19d7504 req-8c99f898-a7f0-42fd-9534-c3a050472ae2 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] No waiting events found dispatching network-vif-unplugged-9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-e4e65e49-b7d7-4f79-99bf-434bc19d7504 req-8c99f898-a7f0-42fd-9534-c3a050472ae2 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Received event network-vif-unplugged-9fcc5742-dd8b-4205-be25-c16830b915a4 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:44 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Instance destroyed successfully.
Nov 07 15:25:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lazy-loading 'resources' on Instance uuid d5341681-9ba6-4f21-a67c-00d50aea8762 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-810810545',display_name='tempest-VolumesAssistedSnapshotsTest-server-810810545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-810810545',id=9,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAPyX9V89fczum9xkG1E1E0AS3SWjaJT5WmQNz2abfZ6UHlZjJrbgR8qM4dLn+3JJcC6AjXNHJzJSwHdd4vrdllS+3FzP/01filvLmE/LWIvp1Vy+JfKOoKO/R0m5fZDw==',key_name='tempest-keypair-719431615',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9378a0a596064f23a0e85400f26a7710',ramdisk_id='',reservation_id='r-zjbzabde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-326356531',owner_user_name='tempest-VolumesAssistedSnapshotsTest-326356531-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fedf60e31c148598e805335cc3f7e50',uuid=d5341681-9ba6-4f21-a67c-00d50aea8762,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fcc5742-dd8b-4205-be25-c16830b915a4", "address": "fa:16:3e:5c:7f:f5", "network": {"id": "05954183-75be-4860-8cc3-fcb57270fc76", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1012347870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9378a0a596064f23a0e85400f26a7710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fcc5742-dd", "ovs_interfaceid": "9fcc5742-dd8b-4205-be25-c16830b915a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Converting VIF {"id": "9fcc5742-dd8b-4205-be25-c16830b915a4", "address": "fa:16:3e:5c:7f:f5", "network": {"id": "05954183-75be-4860-8cc3-fcb57270fc76", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1012347870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9378a0a596064f23a0e85400f26a7710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fcc5742-dd", "ovs_interfaceid": "9fcc5742-dd8b-4205-be25-c16830b915a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:7f:f5,bridge_name='br-int',has_traffic_filtering=True,id=9fcc5742-dd8b-4205-be25-c16830b915a4,network=Network(05954183-75be-4860-8cc3-fcb57270fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fcc5742-dd') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG os_vif [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:7f:f5,bridge_name='br-int',has_traffic_filtering=True,id=9fcc5742-dd8b-4205-be25-c16830b915a4,network=Network(05954183-75be-4860-8cc3-fcb57270fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fcc5742-dd') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fcc5742-dd, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7685347d-1925-4c50-b66f-21ca76b326fc) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:44 user nova-compute[75018]: INFO os_vif [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:7f:f5,bridge_name='br-int',has_traffic_filtering=True,id=9fcc5742-dd8b-4205-be25-c16830b915a4,network=Network(05954183-75be-4860-8cc3-fcb57270fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fcc5742-dd')
Nov 07 15:25:44 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Deleting instance files /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762_del
Nov 07 15:25:44 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Deletion of /opt/stack/data/nova/instances/d5341681-9ba6-4f21-a67c-00d50aea8762_del complete
Nov 07 15:25:44 user nova-compute[75018]: INFO nova.compute.manager [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 07 15:25:44 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:25:44 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.524s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] <== connect_volume: return (1525ms) {'type': 'block', 'scsi_wwn': '23736633539383037', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736633539383037', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077045494',display_name='tempest-ServerActionsTestOtherB-server-2077045494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077045494',id=1,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyBOTPm1HGMtOU1eTQJ9qDH8GeBUu2t+LNMgZBFFRP6tXXqDAukKUUiPODmfxQ+bXcX5mB9tkmMwlkDaHeyRpZSXxAXFTca2PcoYOgGrbYpszpri/wTQI3HjvvfuDY7fQ==',key_name='tempest-keypair-1660361084',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:20:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='585cee0db41e41dda7f10ecfc90f1daf',ramdisk_id='',reservation_id='r-rh7e0y4o',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1343289164',owner_user_name='tempest-ServerActionsTestOtherB-1343289164-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:24:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b867fc1e0742c3a3c5b76ed6fb756e',uuid=8257c590-204a-4fde-8487-79b8c0c87ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-370627506-network", "vif_mac": "fa:16:3e:a6:52:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converting VIF {"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-370627506-network", "vif_mac": "fa:16:3e:a6:52:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:25:45 user nova-compute[75018]:   <uuid>8257c590-204a-4fde-8487-79b8c0c87ea7</uuid>
Nov 07 15:25:45 user nova-compute[75018]:   <name>instance-00000001</name>
Nov 07 15:25:45 user nova-compute[75018]:   <memory>2097152</memory>
Nov 07 15:25:45 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:25:45 user nova-compute[75018]:   <metadata>
Nov 07 15:25:45 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:25:45 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:25:45 user nova-compute[75018]:       <nova:name>tempest-ServerActionsTestOtherB-server-2077045494</nova:name>
Nov 07 15:25:45 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:25:43</nova:creationTime>
Nov 07 15:25:45 user nova-compute[75018]:       <nova:flavor name="m1.small">
Nov 07 15:25:45 user nova-compute[75018]:         <nova:memory>2048</nova:memory>
Nov 07 15:25:45 user nova-compute[75018]:         <nova:disk>20</nova:disk>
Nov 07 15:25:45 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:25:45 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:25:45 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:25:45 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:25:45 user nova-compute[75018]:       <nova:owner>
Nov 07 15:25:45 user nova-compute[75018]:         <nova:user uuid="c6b867fc1e0742c3a3c5b76ed6fb756e">tempest-ServerActionsTestOtherB-1343289164-project-member</nova:user>
Nov 07 15:25:45 user nova-compute[75018]:         <nova:project uuid="585cee0db41e41dda7f10ecfc90f1daf">tempest-ServerActionsTestOtherB-1343289164</nova:project>
Nov 07 15:25:45 user nova-compute[75018]:       </nova:owner>
Nov 07 15:25:45 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:25:45 user nova-compute[75018]:       <nova:ports>
Nov 07 15:25:45 user nova-compute[75018]:         <nova:port uuid="05429ce8-06b2-4693-bf2c-5d03a4343e00">
Nov 07 15:25:45 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 07 15:25:45 user nova-compute[75018]:         </nova:port>
Nov 07 15:25:45 user nova-compute[75018]:       </nova:ports>
Nov 07 15:25:45 user nova-compute[75018]:     </nova:instance>
Nov 07 15:25:45 user nova-compute[75018]:   </metadata>
Nov 07 15:25:45 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:25:45 user nova-compute[75018]:     <system>
Nov 07 15:25:45 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:25:45 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:25:45 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:25:45 user nova-compute[75018]:       <entry name="serial">8257c590-204a-4fde-8487-79b8c0c87ea7</entry>
Nov 07 15:25:45 user nova-compute[75018]:       <entry name="uuid">8257c590-204a-4fde-8487-79b8c0c87ea7</entry>
Nov 07 15:25:45 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:25:45 user nova-compute[75018]:     </system>
Nov 07 15:25:45 user nova-compute[75018]:   </sysinfo>
Nov 07 15:25:45 user nova-compute[75018]:   <os>
Nov 07 15:25:45 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:25:45 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:25:45 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:25:45 user nova-compute[75018]:   </os>
Nov 07 15:25:45 user nova-compute[75018]:   <features>
Nov 07 15:25:45 user nova-compute[75018]:     <acpi/>
Nov 07 15:25:45 user nova-compute[75018]:     <apic/>
Nov 07 15:25:45 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:25:45 user nova-compute[75018]:   </features>
Nov 07 15:25:45 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:25:45 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:25:45 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:25:45 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:25:45 user nova-compute[75018]:   </clock>
Nov 07 15:25:45 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:25:45 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:25:45 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:25:45 user nova-compute[75018]:   </cpu>
Nov 07 15:25:45 user nova-compute[75018]:   <devices>
Nov 07 15:25:45 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:25:45 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:25:45 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk"/>
Nov 07 15:25:45 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:25:45 user nova-compute[75018]:     </disk>
Nov 07 15:25:45 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:25:45 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:25:45 user nova-compute[75018]:       <source dev="/dev/sdc"/>
Nov 07 15:25:45 user nova-compute[75018]:       <target dev="vdb" bus="virtio"/>
Nov 07 15:25:45 user nova-compute[75018]:       <serial>f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf</serial>
Nov 07 15:25:45 user nova-compute[75018]:     </disk>
Nov 07 15:25:45 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:25:45 user nova-compute[75018]:       <mac address="fa:16:3e:a6:52:2c"/>
Nov 07 15:25:45 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:25:45 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:25:45 user nova-compute[75018]:       <target dev="tap05429ce8-06"/>
Nov 07 15:25:45 user nova-compute[75018]:     </interface>
Nov 07 15:25:45 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:25:45 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/console.log" append="off"/>
Nov 07 15:25:45 user nova-compute[75018]:     </serial>
Nov 07 15:25:45 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:25:45 user nova-compute[75018]:     <video>
Nov 07 15:25:45 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:25:45 user nova-compute[75018]:     </video>
Nov 07 15:25:45 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:25:45 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:25:45 user nova-compute[75018]:     </rng>
Nov 07 15:25:45 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:25:45 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:25:45 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:25:45 user nova-compute[75018]:     </memballoon>
Nov 07 15:25:45 user nova-compute[75018]:   </devices>
Nov 07 15:25:45 user nova-compute[75018]: </domain>
Nov 07 15:25:45 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077045494',display_name='tempest-ServerActionsTestOtherB-server-2077045494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077045494',id=1,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyBOTPm1HGMtOU1eTQJ9qDH8GeBUu2t+LNMgZBFFRP6tXXqDAukKUUiPODmfxQ+bXcX5mB9tkmMwlkDaHeyRpZSXxAXFTca2PcoYOgGrbYpszpri/wTQI3HjvvfuDY7fQ==',key_name='tempest-keypair-1660361084',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:20:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='585cee0db41e41dda7f10ecfc90f1daf',ramdisk_id='',reservation_id='r-rh7e0y4o',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1343289164',owner_user_name='tempest-ServerActionsTestOtherB-1343289164-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:24:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b867fc1e0742c3a3c5b76ed6fb756e',uuid=8257c590-204a-4fde-8487-79b8c0c87ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-370627506-network", "vif_mac": "fa:16:3e:a6:52:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converting VIF {"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-370627506-network", "vif_mac": "fa:16:3e:a6:52:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG os_vif [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05a28796-a71d-5119-a6e3-33094ba73afb', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05429ce8-06, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05429ce8-06, col_values=(('qos', UUID('69eddc2a-4905-43bc-aab7-d3d0c3959e5c')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05429ce8-06, col_values=(('external_ids', {'iface-id': '05429ce8-06b2-4693-bf2c-5d03a4343e00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:52:2c', 'vm-uuid': '8257c590-204a-4fde-8487-79b8c0c87ea7'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:25:45 user nova-compute[75018]: INFO os_vif [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06')
Nov 07 15:25:45 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:25:45 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Took 0.70 seconds to deallocate network for instance.
Nov 07 15:25:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] No VIF found with MAC fa:16:3e:a6:52:2c, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:46 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:25:46 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:25:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.539s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:46 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Deleted allocations for instance d5341681-9ba6-4f21-a67c-00d50aea8762
Nov 07 15:25:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e1e602c1-796f-4780-9bdf-1fee91be9f4b tempest-VolumesAssistedSnapshotsTest-326356531 tempest-VolumesAssistedSnapshotsTest-326356531-project-member] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.600s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:46 user nova-compute[75018]: DEBUG nova.compute.manager [req-6e9d8cbe-333e-4d80-9e44-b470c4c1641b req-230c5cc9-0403-4a3e-8549-35135ead5d61 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Received event network-vif-plugged-9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6e9d8cbe-333e-4d80-9e44-b470c4c1641b req-230c5cc9-0403-4a3e-8549-35135ead5d61 service nova] Acquiring lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6e9d8cbe-333e-4d80-9e44-b470c4c1641b req-230c5cc9-0403-4a3e-8549-35135ead5d61 service nova] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6e9d8cbe-333e-4d80-9e44-b470c4c1641b req-230c5cc9-0403-4a3e-8549-35135ead5d61 service nova] Lock "d5341681-9ba6-4f21-a67c-00d50aea8762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:46 user nova-compute[75018]: DEBUG nova.compute.manager [req-6e9d8cbe-333e-4d80-9e44-b470c4c1641b req-230c5cc9-0403-4a3e-8549-35135ead5d61 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] No waiting events found dispatching network-vif-plugged-9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:25:46 user nova-compute[75018]: WARNING nova.compute.manager [req-6e9d8cbe-333e-4d80-9e44-b470c4c1641b req-230c5cc9-0403-4a3e-8549-35135ead5d61 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Received unexpected event network-vif-plugged-9fcc5742-dd8b-4205-be25-c16830b915a4 for instance with vm_state deleted and task_state None.
Nov 07 15:25:46 user nova-compute[75018]: DEBUG nova.compute.manager [req-6e9d8cbe-333e-4d80-9e44-b470c4c1641b req-230c5cc9-0403-4a3e-8549-35135ead5d61 service nova] [instance: d5341681-9ba6-4f21-a67c-00d50aea8762] Received event network-vif-deleted-9fcc5742-dd8b-4205-be25-c16830b915a4 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-c9db7332-9f7f-4991-87bd-a858a8dc1deb req-1d25acf3-f4d2-4970-a109-768cd4144579 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c9db7332-9f7f-4991-87bd-a858a8dc1deb req-1d25acf3-f4d2-4970-a109-768cd4144579 service nova] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c9db7332-9f7f-4991-87bd-a858a8dc1deb req-1d25acf3-f4d2-4970-a109-768cd4144579 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c9db7332-9f7f-4991-87bd-a858a8dc1deb req-1d25acf3-f4d2-4970-a109-768cd4144579 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-c9db7332-9f7f-4991-87bd-a858a8dc1deb req-1d25acf3-f4d2-4970-a109-768cd4144579 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] No waiting events found dispatching network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:25:48 user nova-compute[75018]: WARNING nova.compute.manager [req-c9db7332-9f7f-4991-87bd-a858a8dc1deb req-1d25acf3-f4d2-4970-a109-768cd4144579 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received unexpected event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 for instance with vm_state active and task_state resize_finish.
Nov 07 15:25:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-c9db7332-9f7f-4991-87bd-a858a8dc1deb req-1d25acf3-f4d2-4970-a109-768cd4144579 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c9db7332-9f7f-4991-87bd-a858a8dc1deb req-1d25acf3-f4d2-4970-a109-768cd4144579 service nova] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c9db7332-9f7f-4991-87bd-a858a8dc1deb req-1d25acf3-f4d2-4970-a109-768cd4144579 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c9db7332-9f7f-4991-87bd-a858a8dc1deb req-1d25acf3-f4d2-4970-a109-768cd4144579 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-c9db7332-9f7f-4991-87bd-a858a8dc1deb req-1d25acf3-f4d2-4970-a109-768cd4144579 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] No waiting events found dispatching network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:25:48 user nova-compute[75018]: WARNING nova.compute.manager [req-c9db7332-9f7f-4991-87bd-a858a8dc1deb req-1d25acf3-f4d2-4970-a109-768cd4144579 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received unexpected event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 for instance with vm_state active and task_state resize_finish.
Nov 07 15:25:49 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:25:49 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Instance running successfully.
Nov 07 15:25:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Failed to set time: agent not configured {{(pid=75018) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 07 15:25:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0e7cc81b-62ea-4ce0-95ca-c803d782d794 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] finish_migration finished successfully. {{(pid=75018) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 07 15:25:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-c0ee4f49-fbba-45ae-96fb-a5c158536f13 req-3e28acc1-3de9-4eb7-90ac-d652407f952a service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-changed-82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-c0ee4f49-fbba-45ae-96fb-a5c158536f13 req-3e28acc1-3de9-4eb7-90ac-d652407f952a service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing instance network info cache due to event network-changed-82c43c00-84c9-470a-b788-2372caaad4b2. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:25:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c0ee4f49-fbba-45ae-96fb-a5c158536f13 req-3e28acc1-3de9-4eb7-90ac-d652407f952a service nova] Acquiring lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:25:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c0ee4f49-fbba-45ae-96fb-a5c158536f13 req-3e28acc1-3de9-4eb7-90ac-d652407f952a service nova] Acquired lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:25:55 user nova-compute[75018]: DEBUG nova.network.neutron [req-c0ee4f49-fbba-45ae-96fb-a5c158536f13 req-3e28acc1-3de9-4eb7-90ac-d652407f952a service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Refreshing network info cache for port 82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:25:56 user nova-compute[75018]: DEBUG nova.network.neutron [req-c0ee4f49-fbba-45ae-96fb-a5c158536f13 req-3e28acc1-3de9-4eb7-90ac-d652407f952a service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updated VIF entry in instance network info cache for port 82c43c00-84c9-470a-b788-2372caaad4b2. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:25:56 user nova-compute[75018]: DEBUG nova.network.neutron [req-c0ee4f49-fbba-45ae-96fb-a5c158536f13 req-3e28acc1-3de9-4eb7-90ac-d652407f952a service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updating instance_info_cache with network_info: [{"id": "82c43c00-84c9-470a-b788-2372caaad4b2", "address": "fa:16:3e:3f:70:d2", "network": {"id": "9d6ee218-a040-4dc9-b6f5-7f14d78d624e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1764392216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c43c00-84", "ovs_interfaceid": "82c43c00-84c9-470a-b788-2372caaad4b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "address": "fa:16:3e:92:e5:10", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ab878f-bc", "ovs_interfaceid": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56f2d51d-5593-464f-b7da-df1c81449a23", "address": "fa:16:3e:c6:3c:c1", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f2d51d-55", "ovs_interfaceid": "56f2d51d-5593-464f-b7da-df1c81449a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "address": "fa:16:3e:c2:ab:57", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d8a867-7f", "ovs_interfaceid": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "address": "fa:16:3e:4b:dd:69", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape606a4ce-7e", "ovs_interfaceid": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af3cc600-3a36-42ec-8976-b1c950150d96", "address": "fa:16:3e:81:53:e5", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cc600-3a", "ovs_interfaceid": "af3cc600-3a36-42ec-8976-b1c950150d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c265f2ff-01fc-4405-81dc-7612ee11764e", "address": "fa:16:3e:6c:fc:63", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc265f2ff-01", "ovs_interfaceid": "c265f2ff-01fc-4405-81dc-7612ee11764e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:25:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c0ee4f49-fbba-45ae-96fb-a5c158536f13 req-3e28acc1-3de9-4eb7-90ac-d652407f952a service nova] Releasing lock "refresh_cache-934e9b7f-8bb4-4487-83cd-c5fbc92daefc" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:25:56 user nova-compute[75018]: DEBUG nova.compute.manager [req-7c9c0709-94b0-4033-841c-4c1fac817995 req-81780ef1-ad89-4f7b-bffb-a95db3584c7c service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-changed-73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:56 user nova-compute[75018]: DEBUG nova.compute.manager [req-7c9c0709-94b0-4033-841c-4c1fac817995 req-81780ef1-ad89-4f7b-bffb-a95db3584c7c service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing instance network info cache due to event network-changed-73054878-c401-487b-8a75-1a637723b058. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:25:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7c9c0709-94b0-4033-841c-4c1fac817995 req-81780ef1-ad89-4f7b-bffb-a95db3584c7c service nova] Acquiring lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:25:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7c9c0709-94b0-4033-841c-4c1fac817995 req-81780ef1-ad89-4f7b-bffb-a95db3584c7c service nova] Acquired lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:25:56 user nova-compute[75018]: DEBUG nova.network.neutron [req-7c9c0709-94b0-4033-841c-4c1fac817995 req-81780ef1-ad89-4f7b-bffb-a95db3584c7c service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Refreshing network info cache for port 73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:25:57 user nova-compute[75018]: DEBUG nova.network.neutron [req-7c9c0709-94b0-4033-841c-4c1fac817995 req-81780ef1-ad89-4f7b-bffb-a95db3584c7c service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updated VIF entry in instance network info cache for port 73054878-c401-487b-8a75-1a637723b058. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:25:57 user nova-compute[75018]: DEBUG nova.network.neutron [req-7c9c0709-94b0-4033-841c-4c1fac817995 req-81780ef1-ad89-4f7b-bffb-a95db3584c7c service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [{"id": "73054878-c401-487b-8a75-1a637723b058", "address": "fa:16:3e:e7:75:3b", "network": {"id": "b4f2a6c5-feec-4805-869e-2ede50c3990d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232412547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73054878-c4", "ovs_interfaceid": "73054878-c401-487b-8a75-1a637723b058", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0961679c-4367-4cb0-b7f8-b763408f97c6", "address": "fa:16:3e:4f:9a:a7", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0961679c-43", "ovs_interfaceid": "0961679c-4367-4cb0-b7f8-b763408f97c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "address": "fa:16:3e:e6:8a:29", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda084a72-6e", "ovs_interfaceid": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "106cd061-e91b-4718-8c52-cbaf14defe8c", "address": "fa:16:3e:53:d7:da", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106cd061-e9", "ovs_interfaceid": "106cd061-e91b-4718-8c52-cbaf14defe8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:25:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7c9c0709-94b0-4033-841c-4c1fac817995 req-81780ef1-ad89-4f7b-bffb-a95db3584c7c service nova] Releasing lock "refresh_cache-44f8bf0d-9714-45cf-8f71-206a8bb75a3a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:25:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:58 user nova-compute[75018]: INFO nova.compute.manager [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Terminating instance
Nov 07 15:25:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:25:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-3d528966-7f18-4d09-8365-a6e66bf5d27f req-6995e71d-bf00-43e0-896a-59fc4c895ed3 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-unplugged-82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3d528966-7f18-4d09-8365-a6e66bf5d27f req-6995e71d-bf00-43e0-896a-59fc4c895ed3 service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3d528966-7f18-4d09-8365-a6e66bf5d27f req-6995e71d-bf00-43e0-896a-59fc4c895ed3 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3d528966-7f18-4d09-8365-a6e66bf5d27f req-6995e71d-bf00-43e0-896a-59fc4c895ed3 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-3d528966-7f18-4d09-8365-a6e66bf5d27f req-6995e71d-bf00-43e0-896a-59fc4c895ed3 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-unplugged-82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-3d528966-7f18-4d09-8365-a6e66bf5d27f req-6995e71d-bf00-43e0-896a-59fc4c895ed3 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-unplugged-82c43c00-84c9-470a-b788-2372caaad4b2 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-ab42d4f1-43db-469c-af00-992124ea1e57 req-ce8e399e-e2c8-4300-b89a-224238e6ed82 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-unplugged-17ab878f-bcba-42bf-a4ed-15517fa5e244 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ab42d4f1-43db-469c-af00-992124ea1e57 req-ce8e399e-e2c8-4300-b89a-224238e6ed82 service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ab42d4f1-43db-469c-af00-992124ea1e57 req-ce8e399e-e2c8-4300-b89a-224238e6ed82 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ab42d4f1-43db-469c-af00-992124ea1e57 req-ce8e399e-e2c8-4300-b89a-224238e6ed82 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-ab42d4f1-43db-469c-af00-992124ea1e57 req-ce8e399e-e2c8-4300-b89a-224238e6ed82 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-unplugged-17ab878f-bcba-42bf-a4ed-15517fa5e244 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-ab42d4f1-43db-469c-af00-992124ea1e57 req-ce8e399e-e2c8-4300-b89a-224238e6ed82 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-unplugged-17ab878f-bcba-42bf-a4ed-15517fa5e244 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.012s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:59 user nova-compute[75018]: INFO nova.compute.manager [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Terminating instance
Nov 07 15:25:59 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:25:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:00 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Instance destroyed successfully.
Nov 07 15:26:00 user nova-compute[75018]: DEBUG nova.objects.instance [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lazy-loading 'resources' on Instance uuid 934e9b7f-8bb4-4487-83cd-c5fbc92daefc {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82c43c00-84c9-470a-b788-2372caaad4b2", "address": "fa:16:3e:3f:70:d2", "network": {"id": "9d6ee218-a040-4dc9-b6f5-7f14d78d624e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1764392216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c43c00-84", "ovs_interfaceid": "82c43c00-84c9-470a-b788-2372caaad4b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "82c43c00-84c9-470a-b788-2372caaad4b2", "address": "fa:16:3e:3f:70:d2", "network": {"id": "9d6ee218-a040-4dc9-b6f5-7f14d78d624e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1764392216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c43c00-84", "ovs_interfaceid": "82c43c00-84c9-470a-b788-2372caaad4b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:70:d2,bridge_name='br-int',has_traffic_filtering=True,id=82c43c00-84c9-470a-b788-2372caaad4b2,network=Network(9d6ee218-a040-4dc9-b6f5-7f14d78d624e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c43c00-84') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG os_vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:70:d2,bridge_name='br-int',has_traffic_filtering=True,id=82c43c00-84c9-470a-b788-2372caaad4b2,network=Network(9d6ee218-a040-4dc9-b6f5-7f14d78d624e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c43c00-84') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82c43c00-84, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7347d46-9a0b-4c4c-85f4-466b2cf4fe3d) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: INFO os_vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:70:d2,bridge_name='br-int',has_traffic_filtering=True,id=82c43c00-84c9-470a-b788-2372caaad4b2,network=Network(9d6ee218-a040-4dc9-b6f5-7f14d78d624e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c43c00-84')
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "address": "fa:16:3e:92:e5:10", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ab878f-bc", "ovs_interfaceid": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "address": "fa:16:3e:92:e5:10", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ab878f-bc", "ovs_interfaceid": "17ab878f-bcba-42bf-a4ed-15517fa5e244", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e5:10,bridge_name='br-int',has_traffic_filtering=True,id=17ab878f-bcba-42bf-a4ed-15517fa5e244,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17ab878f-bc') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG os_vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e5:10,bridge_name='br-int',has_traffic_filtering=True,id=17ab878f-bcba-42bf-a4ed-15517fa5e244,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17ab878f-bc') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17ab878f-bc, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:01 user nova-compute[75018]: WARNING nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-82c43c00-84c9-470a-b788-2372caaad4b2 for instance with vm_state active and task_state deleting.
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-unplugged-f7d8a867-7f2c-4f73-8521-b2ec3f646045 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-unplugged-f7d8a867-7f2c-4f73-8521-b2ec3f646045 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-unplugged-f7d8a867-7f2c-4f73-8521-b2ec3f646045 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-f7d8a867-7f2c-4f73-8521-b2ec3f646045 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-f7d8a867-7f2c-4f73-8521-b2ec3f646045 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:01 user nova-compute[75018]: WARNING nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-f7d8a867-7f2c-4f73-8521-b2ec3f646045 for instance with vm_state active and task_state deleting.
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-unplugged-73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-unplugged-73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-unplugged-73054878-c401-487b-8a75-1a637723b058 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:01 user nova-compute[75018]: WARNING nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-73054878-c401-487b-8a75-1a637723b058 for instance with vm_state active and task_state deleting.
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-unplugged-98461dfb-9088-430a-bf24-dd855ff7175b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-unplugged-98461dfb-9088-430a-bf24-dd855ff7175b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-unplugged-98461dfb-9088-430a-bf24-dd855ff7175b for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-98461dfb-9088-430a-bf24-dd855ff7175b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-98461dfb-9088-430a-bf24-dd855ff7175b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:01 user nova-compute[75018]: WARNING nova.compute.manager [req-5e5e8b5a-415c-4f85-8210-fa998476b21e req-421d29e5-c5a3-4202-a9f6-fa2f4a4771ca service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-98461dfb-9088-430a-bf24-dd855ff7175b for instance with vm_state active and task_state deleting.
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-17ab878f-bcba-42bf-a4ed-15517fa5e244 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-17ab878f-bcba-42bf-a4ed-15517fa5e244 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:01 user nova-compute[75018]: WARNING nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-17ab878f-bcba-42bf-a4ed-15517fa5e244 for instance with vm_state active and task_state deleting.
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-unplugged-af3cc600-3a36-42ec-8976-b1c950150d96 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-unplugged-af3cc600-3a36-42ec-8976-b1c950150d96 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-unplugged-af3cc600-3a36-42ec-8976-b1c950150d96 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-af3cc600-3a36-42ec-8976-b1c950150d96 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-af3cc600-3a36-42ec-8976-b1c950150d96 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:01 user nova-compute[75018]: WARNING nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-af3cc600-3a36-42ec-8976-b1c950150d96 for instance with vm_state active and task_state deleting.
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-unplugged-c265f2ff-01fc-4405-81dc-7612ee11764e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-unplugged-c265f2ff-01fc-4405-81dc-7612ee11764e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-unplugged-c265f2ff-01fc-4405-81dc-7612ee11764e for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-c265f2ff-01fc-4405-81dc-7612ee11764e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-c265f2ff-01fc-4405-81dc-7612ee11764e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:01 user nova-compute[75018]: WARNING nova.compute.manager [req-f889d876-f920-4fad-8629-15d441476e9f req-565af3f8-e992-42d7-a452-c84ef150c57d service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-c265f2ff-01fc-4405-81dc-7612ee11764e for instance with vm_state active and task_state deleting.
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Instance destroyed successfully.
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.objects.instance [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lazy-loading 'resources' on Instance uuid 44f8bf0d-9714-45cf-8f71-206a8bb75a3a {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:24:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73054878-c401-487b-8a75-1a637723b058", "address": "fa:16:3e:e7:75:3b", "network": {"id": "b4f2a6c5-feec-4805-869e-2ede50c3990d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232412547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73054878-c4", "ovs_interfaceid": "73054878-c401-487b-8a75-1a637723b058", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "73054878-c401-487b-8a75-1a637723b058", "address": "fa:16:3e:e7:75:3b", "network": {"id": "b4f2a6c5-feec-4805-869e-2ede50c3990d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232412547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73054878-c4", "ovs_interfaceid": "73054878-c401-487b-8a75-1a637723b058", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:75:3b,bridge_name='br-int',has_traffic_filtering=True,id=73054878-c401-487b-8a75-1a637723b058,network=Network(b4f2a6c5-feec-4805-869e-2ede50c3990d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73054878-c4') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG os_vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:75:3b,bridge_name='br-int',has_traffic_filtering=True,id=73054878-c401-487b-8a75-1a637723b058,network=Network(b4f2a6c5-feec-4805-869e-2ede50c3990d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73054878-c4') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73054878-c4, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77e5432e-6a23-48c0-8ec4-cab9dfa84e56) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7947116d-a282-4789-94ae-5bac53b97a57) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: INFO os_vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e5:10,bridge_name='br-int',has_traffic_filtering=True,id=17ab878f-bcba-42bf-a4ed-15517fa5e244,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17ab878f-bc')
Nov 07 15:26:02 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56f2d51d-5593-464f-b7da-df1c81449a23", "address": "fa:16:3e:c6:3c:c1", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f2d51d-55", "ovs_interfaceid": "56f2d51d-5593-464f-b7da-df1c81449a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "56f2d51d-5593-464f-b7da-df1c81449a23", "address": "fa:16:3e:c6:3c:c1", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56f2d51d-55", "ovs_interfaceid": "56f2d51d-5593-464f-b7da-df1c81449a23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:3c:c1,bridge_name='br-int',has_traffic_filtering=True,id=56f2d51d-5593-464f-b7da-df1c81449a23,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56f2d51d-55') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG os_vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:3c:c1,bridge_name='br-int',has_traffic_filtering=True,id=56f2d51d-5593-464f-b7da-df1c81449a23,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56f2d51d-55') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56f2d51d-55, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:02 user nova-compute[75018]: INFO os_vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:75:3b,bridge_name='br-int',has_traffic_filtering=True,id=73054878-c401-487b-8a75-1a637723b058,network=Network(b4f2a6c5-feec-4805-869e-2ede50c3990d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73054878-c4')
Nov 07 15:26:02 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:24:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c0:d9,bridge_name='br-int',has_traffic_filtering=True,id=98461dfb-9088-430a-bf24-dd855ff7175b,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98461dfb-90') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG os_vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c0:d9,bridge_name='br-int',has_traffic_filtering=True,id=98461dfb-9088-430a-bf24-dd855ff7175b,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98461dfb-90') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98461dfb-90, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eee48146-8a3f-4591-a45b-773e9e44f392) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=748dfe2b-7ad2-47e6-8742-4ebbd6f3ad79) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: INFO os_vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:3c:c1,bridge_name='br-int',has_traffic_filtering=True,id=56f2d51d-5593-464f-b7da-df1c81449a23,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap56f2d51d-55')
Nov 07 15:26:02 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "address": "fa:16:3e:c2:ab:57", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d8a867-7f", "ovs_interfaceid": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "address": "fa:16:3e:c2:ab:57", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d8a867-7f", "ovs_interfaceid": "f7d8a867-7f2c-4f73-8521-b2ec3f646045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ab:57,bridge_name='br-int',has_traffic_filtering=True,id=f7d8a867-7f2c-4f73-8521-b2ec3f646045,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d8a867-7f') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG os_vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ab:57,bridge_name='br-int',has_traffic_filtering=True,id=f7d8a867-7f2c-4f73-8521-b2ec3f646045,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d8a867-7f') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "0e508411-09db-48b8-98a5-1ccd9f4f6031" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG nova.compute.manager [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7d8a867-7f, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:02 user nova-compute[75018]: INFO os_vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c0:d9,bridge_name='br-int',has_traffic_filtering=True,id=98461dfb-9088-430a-bf24-dd855ff7175b,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98461dfb-90')
Nov 07 15:26:02 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:24:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:38:52,bridge_name='br-int',has_traffic_filtering=True,id=d1383062-7e89-4ca1-a140-27490e36d621,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1383062-7e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG os_vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:38:52,bridge_name='br-int',has_traffic_filtering=True,id=d1383062-7e89-4ca1-a140-27490e36d621,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1383062-7e') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:26:02 user nova-compute[75018]: INFO nova.compute.claims [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Claim successful on node user
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1383062-7e, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=049a27e1-22b8-45e3-9deb-95a79de9228a) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7bcbe0c-7752-4a25-a928-26dd87fff788) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: INFO os_vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ab:57,bridge_name='br-int',has_traffic_filtering=True,id=f7d8a867-7f2c-4f73-8521-b2ec3f646045,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d8a867-7f')
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "address": "fa:16:3e:4b:dd:69", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape606a4ce-7e", "ovs_interfaceid": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "address": "fa:16:3e:4b:dd:69", "network": {"id": "a0180964-10d5-4764-bc09-ab7f76b0de68", "bridge": "br-int", "label": "tempest-device-tagging-net1-1591386121", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape606a4ce-7e", "ovs_interfaceid": "e606a4ce-7ebe-46db-8e2b-71dc2ee247a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:dd:69,bridge_name='br-int',has_traffic_filtering=True,id=e606a4ce-7ebe-46db-8e2b-71dc2ee247a1,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape606a4ce-7e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:dd:69,bridge_name='br-int',has_traffic_filtering=True,id=e606a4ce-7ebe-46db-8e2b-71dc2ee247a1,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape606a4ce-7e') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape606a4ce-7e, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: INFO os_vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:38:52,bridge_name='br-int',has_traffic_filtering=True,id=d1383062-7e89-4ca1-a140-27490e36d621,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1383062-7e')
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:24:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:fb:92,bridge_name='br-int',has_traffic_filtering=True,id=5a2e7ee9-58c4-46e3-8f31-961dfb488150,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e7ee9-58') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:fb:92,bridge_name='br-int',has_traffic_filtering=True,id=5a2e7ee9-58c4-46e3-8f31-961dfb488150,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e7ee9-58') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a2e7ee9-58, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df180dbe-eaf1-40ac-a094-77eef33d1a84) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-0d8176f5-93dd-4bf2-bb9e-da23fcee9fa1 req-85132a2a-5cb5-402f-93c2-74a7e19455e9 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-unplugged-56f2d51d-5593-464f-b7da-df1c81449a23 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0d8176f5-93dd-4bf2-bb9e-da23fcee9fa1 req-85132a2a-5cb5-402f-93c2-74a7e19455e9 service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0d8176f5-93dd-4bf2-bb9e-da23fcee9fa1 req-85132a2a-5cb5-402f-93c2-74a7e19455e9 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0d8176f5-93dd-4bf2-bb9e-da23fcee9fa1 req-85132a2a-5cb5-402f-93c2-74a7e19455e9 service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-0d8176f5-93dd-4bf2-bb9e-da23fcee9fa1 req-85132a2a-5cb5-402f-93c2-74a7e19455e9 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-unplugged-56f2d51d-5593-464f-b7da-df1c81449a23 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-0d8176f5-93dd-4bf2-bb9e-da23fcee9fa1 req-85132a2a-5cb5-402f-93c2-74a7e19455e9 service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-unplugged-56f2d51d-5593-464f-b7da-df1c81449a23 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd4e511f-e8fb-4324-8a67-6507ba63d74f) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: INFO os_vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:dd:69,bridge_name='br-int',has_traffic_filtering=True,id=e606a4ce-7ebe-46db-8e2b-71dc2ee247a1,network=Network(a0180964-10d5-4764-bc09-ab7f76b0de68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape606a4ce-7e')
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af3cc600-3a36-42ec-8976-b1c950150d96", "address": "fa:16:3e:81:53:e5", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cc600-3a", "ovs_interfaceid": "af3cc600-3a36-42ec-8976-b1c950150d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "af3cc600-3a36-42ec-8976-b1c950150d96", "address": "fa:16:3e:81:53:e5", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cc600-3a", "ovs_interfaceid": "af3cc600-3a36-42ec-8976-b1c950150d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:53:e5,bridge_name='br-int',has_traffic_filtering=True,id=af3cc600-3a36-42ec-8976-b1c950150d96,network=Network(52802d24-4900-4a5b-a787-9d62114be5fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3cc600-3a') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:53:e5,bridge_name='br-int',has_traffic_filtering=True,id=af3cc600-3a36-42ec-8976-b1c950150d96,network=Network(52802d24-4900-4a5b-a787-9d62114be5fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3cc600-3a') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf3cc600-3a, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: INFO os_vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:fb:92,bridge_name='br-int',has_traffic_filtering=True,id=5a2e7ee9-58c4-46e3-8f31-961dfb488150,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e7ee9-58')
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:24:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0961679c-4367-4cb0-b7f8-b763408f97c6", "address": "fa:16:3e:4f:9a:a7", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0961679c-43", "ovs_interfaceid": "0961679c-4367-4cb0-b7f8-b763408f97c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "0961679c-4367-4cb0-b7f8-b763408f97c6", "address": "fa:16:3e:4f:9a:a7", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0961679c-43", "ovs_interfaceid": "0961679c-4367-4cb0-b7f8-b763408f97c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9a:a7,bridge_name='br-int',has_traffic_filtering=True,id=0961679c-4367-4cb0-b7f8-b763408f97c6,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0961679c-43') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9a:a7,bridge_name='br-int',has_traffic_filtering=True,id=0961679c-4367-4cb0-b7f8-b763408f97c6,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0961679c-43') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0961679c-43, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8eebe288-1ea5-4411-a538-bd7f3ca6e2b2) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b54e63c-2dc5-4c07-9cff-79a091eb0ec8) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: INFO os_vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:53:e5,bridge_name='br-int',has_traffic_filtering=True,id=af3cc600-3a36-42ec-8976-b1c950150d96,network=Network(52802d24-4900-4a5b-a787-9d62114be5fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3cc600-3a')
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411871331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411871331',id=11,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS9oOwgHcokjuyHvPVhpDmRkaVFkSNnhWNZWgehoVJxrVBfJioKevVjm2UGtZpmDv/z2k9FZb9FPpnnjy4wyNjo1iKT+3bPj9efllxgRONq6X+fq1JwZk3QY7n1EUg76Q==',key_name='tempest-keypair-1741646905',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe38e9e3e1d24bb3b3b8b910b1de52ee',ramdisk_id='',reservation_id='r-i741n1ya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1150033045',owner_user_name='tempest-TaggedBootDevicesTest_v242-1150033045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3cbd57eebe4bba85843cc4608ec75e',uuid=934e9b7f-8bb4-4487-83cd-c5fbc92daefc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c265f2ff-01fc-4405-81dc-7612ee11764e", "address": "fa:16:3e:6c:fc:63", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc265f2ff-01", "ovs_interfaceid": "c265f2ff-01fc-4405-81dc-7612ee11764e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converting VIF {"id": "c265f2ff-01fc-4405-81dc-7612ee11764e", "address": "fa:16:3e:6c:fc:63", "network": {"id": "52802d24-4900-4a5b-a787-9d62114be5fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-568161050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe38e9e3e1d24bb3b3b8b910b1de52ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc265f2ff-01", "ovs_interfaceid": "c265f2ff-01fc-4405-81dc-7612ee11764e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fc:63,bridge_name='br-int',has_traffic_filtering=True,id=c265f2ff-01fc-4405-81dc-7612ee11764e,network=Network(52802d24-4900-4a5b-a787-9d62114be5fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc265f2ff-01') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fc:63,bridge_name='br-int',has_traffic_filtering=True,id=c265f2ff-01fc-4405-81dc-7612ee11764e,network=Network(52802d24-4900-4a5b-a787-9d62114be5fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc265f2ff-01') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc265f2ff-01, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: INFO os_vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9a:a7,bridge_name='br-int',has_traffic_filtering=True,id=0961679c-4367-4cb0-b7f8-b763408f97c6,network=Network(99dfb93a-eb29-4f4c-8312-44505fc44124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0961679c-43')
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:24:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "address": "fa:16:3e:e6:8a:29", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda084a72-6e", "ovs_interfaceid": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "address": "fa:16:3e:e6:8a:29", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda084a72-6e", "ovs_interfaceid": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8a:29,bridge_name='br-int',has_traffic_filtering=True,id=da084a72-6ed7-46b9-960e-3f9cd2e0ebf6,network=Network(5bd166f6-af0c-4a90-8f62-a6c479f18e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda084a72-6e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8a:29,bridge_name='br-int',has_traffic_filtering=True,id=da084a72-6ed7-46b9-960e-3f9cd2e0ebf6,network=Network(5bd166f6-af0c-4a90-8f62-a6c479f18e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda084a72-6e') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda084a72-6e, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-unplugged-5a2e7ee9-58c4-46e3-8f31-961dfb488150 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-unplugged-5a2e7ee9-58c4-46e3-8f31-961dfb488150 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-unplugged-5a2e7ee9-58c4-46e3-8f31-961dfb488150 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-5a2e7ee9-58c4-46e3-8f31-961dfb488150 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-5a2e7ee9-58c4-46e3-8f31-961dfb488150 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:03 user nova-compute[75018]: WARNING nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-5a2e7ee9-58c4-46e3-8f31-961dfb488150 for instance with vm_state active and task_state deleting.
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-unplugged-d1383062-7e89-4ca1-a140-27490e36d621 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-unplugged-d1383062-7e89-4ca1-a140-27490e36d621 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-unplugged-d1383062-7e89-4ca1-a140-27490e36d621 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-d1383062-7e89-4ca1-a140-27490e36d621 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-d1383062-7e89-4ca1-a140-27490e36d621 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:03 user nova-compute[75018]: WARNING nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-d1383062-7e89-4ca1-a140-27490e36d621 for instance with vm_state active and task_state deleting.
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-unplugged-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-unplugged-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-unplugged-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:03 user nova-compute[75018]: WARNING nova.compute.manager [req-5b2cedb4-246d-41b2-9a34-662845495e47 req-c7242620-b36a-473f-8fa4-084560552966 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 for instance with vm_state active and task_state deleting.
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c1a7f84-a1b9-4bea-b04a-9024523142e9) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.717s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab44cd1b-8344-4c6f-99d9-db16bae60e2e) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: INFO os_vif [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fc:63,bridge_name='br-int',has_traffic_filtering=True,id=c265f2ff-01fc-4405-81dc-7612ee11764e,network=Network(52802d24-4900-4a5b-a787-9d62114be5fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc265f2ff-01')
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMGdXsrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:26:03 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:03 user nova-compute[75018]: INFO os_vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8a:29,bridge_name='br-int',has_traffic_filtering=True,id=da084a72-6ed7-46b9-960e-3f9cd2e0ebf6,network=Network(5bd166f6-af0c-4a90-8f62-a6c479f18e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda084a72-6e')
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T15:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-50242220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-50242220',id=12,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+DrsL/GM3ZUPGcvEmdjHtjj+iDnY8NNK0gzrdPmUNV/8+hq+bGEbBxjj0sU5MXDQVAxH8d10CsKUBuYeg3k11N77ETS+F3nSF+poa/j+jS3R2X7yg/qACc+p5zKfy6cw==',key_name='tempest-keypair-288144119',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9973265f38de417c9af4de9eb09ce262',ramdisk_id='',reservation_id='r-4b6j3ppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-224611665',owner_user_name='tempest-TaggedBootDevicesTest-224611665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:24:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac6aff2e0eae4806bb862abfb9f31d0b',uuid=44f8bf0d-9714-45cf-8f71-206a8bb75a3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "106cd061-e91b-4718-8c52-cbaf14defe8c", "address": "fa:16:3e:53:d7:da", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106cd061-e9", "ovs_interfaceid": "106cd061-e91b-4718-8c52-cbaf14defe8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converting VIF {"id": "106cd061-e91b-4718-8c52-cbaf14defe8c", "address": "fa:16:3e:53:d7:da", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106cd061-e9", "ovs_interfaceid": "106cd061-e91b-4718-8c52-cbaf14defe8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=106cd061-e91b-4718-8c52-cbaf14defe8c,network=Network(5bd166f6-af0c-4a90-8f62-a6c479f18e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106cd061-e9') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=106cd061-e91b-4718-8c52-cbaf14defe8c,network=Network(5bd166f6-af0c-4a90-8f62-a6c479f18e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106cd061-e9') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap106cd061-e9, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0627ca2e-13da-4f90-951a-a1382cef47d8) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:03 user nova-compute[75018]: INFO os_vif [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=106cd061-e91b-4718-8c52-cbaf14defe8c,network=Network(5bd166f6-af0c-4a90-8f62-a6c479f18e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106cd061-e9')
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORALivPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:26:03 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc739fba-239d-4917-9e1d-963e2b21b7d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:26:03 user nova-compute[75018]: No targets found.
Nov 07 15:26:03 user nova-compute[75018]: iSNS:
Nov 07 15:26:03 user nova-compute[75018]: No targets found.
Nov 07 15:26:03 user nova-compute[75018]: STATIC:
Nov 07 15:26:03 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3
Nov 07 15:26:03 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:03 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:03 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042
Nov 07 15:26:03 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:03 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:03 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6
Nov 07 15:26:03 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:03 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:03 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1
Nov 07 15:26:03 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:03 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:03 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a
Nov 07 15:26:03 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:03 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:03 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867
Nov 07 15:26:03 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:03 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:03 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:26:03 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:03 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:03 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6
Nov 07 15:26:03 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:03 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:03 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf
Nov 07 15:26:03 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:03 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:03 user nova-compute[75018]: FIRMWARE:
Nov 07 15:26:03 user nova-compute[75018]: No targets found.
Nov 07 15:26:03 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:26:03 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:26:03 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d785828b-1201-43d5-8ee6-17c1d4538a0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.network.neutron [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:26:03 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[724d327f-3146-4dd7-87c8-2da91d817c02]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:26:03 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 (non-flash)
Nov 07 15:26:03 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:26:03 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae0755b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc6b1ee-5b07-4c64-8356-87df4a1a22f0]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe25b6c4-64ba-4aef-9fef-ed730d2f139e]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f43392-e1ed-4942-9b24-05c37b871278]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce9f6aa-90fc-45a8-9b9f-bdbde9430f89]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.compute.manager [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:26:03 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Creating image(s)
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "/opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "/opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b93ab6-c7a6-422a-9562-1c9f2b328df4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:03 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a529dca0-d856-4c1d-961e-8dd8e1d02725]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867, portal: 172.16.0.220,3260]
Nov 07 15:26:04 user nova-compute[75018]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867, portal: 172.16.0.220,3260] successful.
Nov 07 15:26:04 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9e83453-bfee-4260-986f-6df2d7963867 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c0dbde-f88d-408c-bfda-43e780d233ba]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] <== disconnect_volume: return (439ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.410s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlcspWVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:26:04 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab44419-5c3a-423c-b4d9-6c4b6c7c1f4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:26:04 user nova-compute[75018]: No targets found.
Nov 07 15:26:04 user nova-compute[75018]: iSNS:
Nov 07 15:26:04 user nova-compute[75018]: No targets found.
Nov 07 15:26:04 user nova-compute[75018]: STATIC:
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: FIRMWARE:
Nov 07 15:26:04 user nova-compute[75018]: No targets found.
Nov 07 15:26:04 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:26:04 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:26:04 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[98311fff-a246-47c0-9b28-665d5fe447bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e46dab-599f-4fd8-a27f-6ac91cad8d1f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feaf8239ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042'): ({'sdj'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Removing single pathed devices sdj {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.216s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[22693025-c31c-497a-b4c5-30422a274150]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2920b0b0-74ec-48a5-b376-abbbda409e80]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Flushing IO for device /dev/sdj {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf93915-ef26-421f-ad21-12cebf0d2809]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG nova.policy [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6b39ca6e2db4be9a71fca8389bce83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da5c809b9e14547855ac986915e8c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.047s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b24f293-8f3f-4547-aa2e-ab9287044c0e]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] SCSI volumes sdj have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ce9a6f-f040-4a06-8a40-9a45746652d7]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.204s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[512f32a8-7381-4d3e-ab02-eca136e07c04]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042, portal: 172.16.0.220,3260]
Nov 07 15:26:04 user nova-compute[75018]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042, portal: 172.16.0.220,3260] successful.
Nov 07 15:26:04 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk 1073741824" returned: 0 in 0.079s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3ccb9-d419-4301-b804-fb5c6a8e4042 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eae5f37-b709-486f-b0df-b26dc91e59b1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] <== disconnect_volume: return (843ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.441s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjBQJsLA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:26:04 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a41897-6f6b-4800-a6d4-00eb5dab331b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:26:04 user nova-compute[75018]: No targets found.
Nov 07 15:26:04 user nova-compute[75018]: iSNS:
Nov 07 15:26:04 user nova-compute[75018]: No targets found.
Nov 07 15:26:04 user nova-compute[75018]: STATIC:
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: FIRMWARE:
Nov 07 15:26:04 user nova-compute[75018]: No targets found.
Nov 07 15:26:04 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:26:04 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:26:04 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[55afe1dc-959f-40a7-95fe-2f61a132b95e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8524fc-93e1-4849-86be-3bd841290fa6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 (non-flash)
Nov 07 15:26:04 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feaf823bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3'): ({'sdg'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Removing single pathed devices sdg {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.169s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd686d45-6455-4b7d-a4e9-0cbb55ca5b57]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[34392e5b-a8d8-4214-a7b7-a8a6830bd7b4]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Flushing IO for device /dev/sdg {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4619c04-ee4f-4742-826f-dad63271723b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b63f07-e424-41fc-b9d8-3dba37adb5af]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] SCSI volumes sdg have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdff0c8-00c6-4078-aa6d-0cee6f4455b5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Cannot resize image /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Ensure instance console log exists: /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8cf3e5-7459-4b1f-b14a-e66b52579992]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3, portal: 172.16.0.220,3260]
Nov 07 15:26:04 user nova-compute[75018]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3, portal: 172.16.0.220,3260] successful.
Nov 07 15:26:04 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29be4268-c29e-452c-a5a0-0edd6a9d3eb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a99d39-a5e0-4732-bb3d-c1461ff36601]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.458s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] <== disconnect_volume: return (899ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.441s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKBbcVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:26:04 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a14777-4200-4ef6-888b-983e85c4cca9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:26:04 user nova-compute[75018]: No targets found.
Nov 07 15:26:04 user nova-compute[75018]: iSNS:
Nov 07 15:26:04 user nova-compute[75018]: No targets found.
Nov 07 15:26:04 user nova-compute[75018]: STATIC:
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf
Nov 07 15:26:04 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:04 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:04 user nova-compute[75018]: FIRMWARE:
Nov 07 15:26:04 user nova-compute[75018]: No targets found.
Nov 07 15:26:04 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:26:04 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:26:04 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:26:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddccff5-b688-4cea-94a9-e11c6bc2f64e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6f78fc-bad8-480b-b261-ccda8628c774]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb083ba440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6'): ({'sdk'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Removing single pathed devices sdk {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafdf149-9141-4ca8-8168-7899e87e869e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1c31cf-4cc3-4856-b517-b82549148f78]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Flushing IO for device /dev/sdk {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07cabe4-68a1-47e8-bcf6-26522b664c0f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e354b33-9b96-4dca-b263-298d33bd7a7c]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] SCSI volumes sdk have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fc7ecd-3379-4e39-85f4-128201909a33]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab19632-d2cc-4640-bec2-d80d181c8f02]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6, portal: 172.16.0.220,3260]
Nov 07 15:26:05 user nova-compute[75018]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6, portal: 172.16.0.220,3260] successful.
Nov 07 15:26:05 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37beef21-da5e-4cfb-8dae-11c45d37d1d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e1b1c9-d62a-4e2e-90d4-3c0d5f895ad3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] <== disconnect_volume: return (785ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.343s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQeokpqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:26:05 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-56f2d51d-5593-464f-b7da-df1c81449a23 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-56f2d51d-5593-464f-b7da-df1c81449a23 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:05 user nova-compute[75018]: WARNING nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-56f2d51d-5593-464f-b7da-df1c81449a23 for instance with vm_state active and task_state deleting.
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-unplugged-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-unplugged-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-unplugged-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-plugged-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Acquiring lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] No waiting events found dispatching network-vif-plugged-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:05 user nova-compute[75018]: WARNING nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received unexpected event network-vif-plugged-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 for instance with vm_state active and task_state deleting.
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-unplugged-0961679c-4367-4cb0-b7f8-b763408f97c6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-unplugged-0961679c-4367-4cb0-b7f8-b763408f97c6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-unplugged-0961679c-4367-4cb0-b7f8-b763408f97c6 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-0961679c-4367-4cb0-b7f8-b763408f97c6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-0961679c-4367-4cb0-b7f8-b763408f97c6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:05 user nova-compute[75018]: WARNING nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-0961679c-4367-4cb0-b7f8-b763408f97c6 for instance with vm_state active and task_state deleting.
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-unplugged-106cd061-e91b-4718-8c52-cbaf14defe8c {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-unplugged-106cd061-e91b-4718-8c52-cbaf14defe8c {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-2387eac2-1bef-4861-abc9-508411b09b9f req-7de8a7e9-1c7f-493f-840f-37c7f069e47c service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-unplugged-106cd061-e91b-4718-8c52-cbaf14defe8c for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea87ccff-83a6-44fa-b64b-9eeaf703ab20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.network.neutron [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Successfully created port: 88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:26:05 user nova-compute[75018]: No targets found.
Nov 07 15:26:05 user nova-compute[75018]: iSNS:
Nov 07 15:26:05 user nova-compute[75018]: No targets found.
Nov 07 15:26:05 user nova-compute[75018]: STATIC:
Nov 07 15:26:05 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6
Nov 07 15:26:05 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:05 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:05 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1
Nov 07 15:26:05 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:05 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:05 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a
Nov 07 15:26:05 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:05 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:05 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:26:05 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:05 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:05 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf
Nov 07 15:26:05 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:05 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:05 user nova-compute[75018]: FIRMWARE:
Nov 07 15:26:05 user nova-compute[75018]: No targets found.
Nov 07 15:26:05 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:26:05 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:26:05 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cf2397-46e1-40bc-827f-e9ddecc4c854]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b092ef-110d-46c4-8699-d5dccd763654]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae06e0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1'): ({'sdh'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Removing single pathed devices sdh {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2d5875-fbdf-47b9-800b-858ad49de9a0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d03390-719e-48bd-af82-28dd25c50593]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Flushing IO for device /dev/sdh {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[686fe733-8068-41b8-9dd8-175978eda663]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[abda0f90-b274-44a3-b1a5-d784180452cf]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] SCSI volumes sdh have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d936b4f-9e63-439d-b8d6-b0f14d73d70d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8b9f1b-1a9b-431d-a344-9b5950da08ce]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1, portal: 172.16.0.220,3260]
Nov 07 15:26:05 user nova-compute[75018]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1, portal: 172.16.0.220,3260] successful.
Nov 07 15:26:05 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba300fbd-97e8-4e36-a021-caac03c8f2c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[415ccc20-b627-4e7f-b9ce-32c9fe1b47ca]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] <== disconnect_volume: return (712ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:26:05 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Deleting instance files /opt/stack/data/nova/instances/934e9b7f-8bb4-4487-83cd-c5fbc92daefc_del
Nov 07 15:26:05 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Deletion of /opt/stack/data/nova/instances/934e9b7f-8bb4-4487-83cd-c5fbc92daefc_del complete
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.373s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d338129-2c0e-4e59-bf2c-3d8f5db45800]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:26:05 user nova-compute[75018]: No targets found.
Nov 07 15:26:05 user nova-compute[75018]: iSNS:
Nov 07 15:26:05 user nova-compute[75018]: No targets found.
Nov 07 15:26:05 user nova-compute[75018]: STATIC:
Nov 07 15:26:05 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6
Nov 07 15:26:05 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:05 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:05 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a
Nov 07 15:26:05 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:05 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:05 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:26:05 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:05 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:05 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf
Nov 07 15:26:05 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:26:05 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:26:05 user nova-compute[75018]: FIRMWARE:
Nov 07 15:26:05 user nova-compute[75018]: No targets found.
Nov 07 15:26:05 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:26:05 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:26:05 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3dde6b-133d-42cb-9bbc-c5ff98bdb348]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: INFO nova.compute.manager [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Took 7.12 seconds to destroy the instance on the hypervisor.
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59a2182-e88c-4750-9c00-a920d91bb694]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:26:05 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:26:05 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae06e1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a'): ({'sdl'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Removing single pathed devices sdl {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f96f40d-630d-4f42-91db-f55a2787054a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b43ef6e-2037-4ef1-921d-5bd0429db2bd]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Flushing IO for device /dev/sdl {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24eafb1-6675-4745-a91c-b8f06e378fde]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.039s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[87682990-c859-4ec6-a904-819ba09f244c]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] SCSI volumes sdl have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f152e45e-4aeb-4f43-91f1-05b5fd6c8707]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ac3cdc-dda2-4622-96b7-4e4c12b45603]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a, portal: 172.16.0.220,3260]
Nov 07 15:26:05 user nova-compute[75018]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a, portal: 172.16.0.220,3260] successful.
Nov 07 15:26:05 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d102cc69-aac9-407f-b1f3-5b9d70fa7b5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa621fd-a189-4053-a40a-fec43e4caa18]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] <== disconnect_volume: return (708ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:26:06 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Deleting instance files /opt/stack/data/nova/instances/44f8bf0d-9714-45cf-8f71-206a8bb75a3a_del
Nov 07 15:26:06 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Deletion of /opt/stack/data/nova/instances/44f8bf0d-9714-45cf-8f71-206a8bb75a3a_del complete
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.network.neutron [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Successfully updated port: 88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:26:06 user nova-compute[75018]: INFO nova.compute.manager [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Took 6.50 seconds to destroy the instance on the hypervisor.
Nov 07 15:26:06 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquired lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.network.neutron [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.network.neutron [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.network.neutron [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updating instance_info_cache with network_info: [{"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Releasing lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Instance network_info: |[{"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Start _get_guest_xml network_info=[{"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:26:06 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:26:06 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:26:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-409192157',display_name='tempest-ServerActionsTestOtherA-server-409192157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-409192157',id=15,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWUuR4eTrthHIodCYA4J9kJfg+RXJSyXAWybmq/Ac2FttoM8S/nLdDec5RLFtfiG+hcM5DvHo1f+xa7mxv4L56s6Q3dpUvRcBzbdTOGBBvgSiAYU0HY5RSxW2+5w/RcXA==',key_name='tempest-keypair-2049594144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-skbl9h5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:26:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=0e508411-09db-48b8-98a5-1ccd9f4f6031,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ab:e0,bridge_name='br-int',has_traffic_filtering=True,id=88ce52b1-c8b7-4958-ad77-4424811b13b6,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ce52b1-c8') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.objects.instance [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e508411-09db-48b8-98a5-1ccd9f4f6031 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:26:06 user nova-compute[75018]:   <uuid>0e508411-09db-48b8-98a5-1ccd9f4f6031</uuid>
Nov 07 15:26:06 user nova-compute[75018]:   <name>instance-0000000f</name>
Nov 07 15:26:06 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:26:06 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:26:06 user nova-compute[75018]:   <metadata>
Nov 07 15:26:06 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:26:06 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:26:06 user nova-compute[75018]:       <nova:name>tempest-ServerActionsTestOtherA-server-409192157</nova:name>
Nov 07 15:26:06 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:26:06</nova:creationTime>
Nov 07 15:26:06 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:26:06 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:26:06 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:26:06 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:26:06 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:26:06 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:26:06 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:26:06 user nova-compute[75018]:       <nova:owner>
Nov 07 15:26:06 user nova-compute[75018]:         <nova:user uuid="c6b39ca6e2db4be9a71fca8389bce83f">tempest-ServerActionsTestOtherA-1198683339-project-member</nova:user>
Nov 07 15:26:06 user nova-compute[75018]:         <nova:project uuid="8da5c809b9e14547855ac986915e8c99">tempest-ServerActionsTestOtherA-1198683339</nova:project>
Nov 07 15:26:06 user nova-compute[75018]:       </nova:owner>
Nov 07 15:26:06 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:26:06 user nova-compute[75018]:       <nova:ports>
Nov 07 15:26:06 user nova-compute[75018]:         <nova:port uuid="88ce52b1-c8b7-4958-ad77-4424811b13b6">
Nov 07 15:26:06 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 07 15:26:06 user nova-compute[75018]:         </nova:port>
Nov 07 15:26:06 user nova-compute[75018]:       </nova:ports>
Nov 07 15:26:06 user nova-compute[75018]:     </nova:instance>
Nov 07 15:26:06 user nova-compute[75018]:   </metadata>
Nov 07 15:26:06 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:26:06 user nova-compute[75018]:     <system>
Nov 07 15:26:06 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:26:06 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:26:06 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:26:06 user nova-compute[75018]:       <entry name="serial">0e508411-09db-48b8-98a5-1ccd9f4f6031</entry>
Nov 07 15:26:06 user nova-compute[75018]:       <entry name="uuid">0e508411-09db-48b8-98a5-1ccd9f4f6031</entry>
Nov 07 15:26:06 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:26:06 user nova-compute[75018]:     </system>
Nov 07 15:26:06 user nova-compute[75018]:   </sysinfo>
Nov 07 15:26:06 user nova-compute[75018]:   <os>
Nov 07 15:26:06 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:26:06 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:26:06 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:26:06 user nova-compute[75018]:   </os>
Nov 07 15:26:06 user nova-compute[75018]:   <features>
Nov 07 15:26:06 user nova-compute[75018]:     <acpi/>
Nov 07 15:26:06 user nova-compute[75018]:     <apic/>
Nov 07 15:26:06 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:26:06 user nova-compute[75018]:   </features>
Nov 07 15:26:06 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:26:06 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:26:06 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:26:06 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:26:06 user nova-compute[75018]:   </clock>
Nov 07 15:26:06 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:26:06 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:26:06 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:26:06 user nova-compute[75018]:   </cpu>
Nov 07 15:26:06 user nova-compute[75018]:   <devices>
Nov 07 15:26:06 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:26:06 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:26:06 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk"/>
Nov 07 15:26:06 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:26:06 user nova-compute[75018]:     </disk>
Nov 07 15:26:06 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:26:06 user nova-compute[75018]:       <mac address="fa:16:3e:d3:ab:e0"/>
Nov 07 15:26:06 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:26:06 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:26:06 user nova-compute[75018]:       <target dev="tap88ce52b1-c8"/>
Nov 07 15:26:06 user nova-compute[75018]:     </interface>
Nov 07 15:26:06 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:26:06 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/console.log" append="off"/>
Nov 07 15:26:06 user nova-compute[75018]:     </serial>
Nov 07 15:26:06 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:26:06 user nova-compute[75018]:     <video>
Nov 07 15:26:06 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:26:06 user nova-compute[75018]:     </video>
Nov 07 15:26:06 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:26:06 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:26:06 user nova-compute[75018]:     </rng>
Nov 07 15:26:06 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:26:06 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:26:06 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:26:06 user nova-compute[75018]:     </memballoon>
Nov 07 15:26:06 user nova-compute[75018]:   </devices>
Nov 07 15:26:06 user nova-compute[75018]: </domain>
Nov 07 15:26:06 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:26:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-409192157',display_name='tempest-ServerActionsTestOtherA-server-409192157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-409192157',id=15,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWUuR4eTrthHIodCYA4J9kJfg+RXJSyXAWybmq/Ac2FttoM8S/nLdDec5RLFtfiG+hcM5DvHo1f+xa7mxv4L56s6Q3dpUvRcBzbdTOGBBvgSiAYU0HY5RSxW2+5w/RcXA==',key_name='tempest-keypair-2049594144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-skbl9h5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:26:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=0e508411-09db-48b8-98a5-1ccd9f4f6031,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ab:e0,bridge_name='br-int',has_traffic_filtering=True,id=88ce52b1-c8b7-4958-ad77-4424811b13b6,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ce52b1-c8') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG os_vif [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ab:e0,bridge_name='br-int',has_traffic_filtering=True,id=88ce52b1-c8b7-4958-ad77-4424811b13b6,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ce52b1-c8') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a25efded-760a-590d-8845-b89d0e358fc7', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88ce52b1-c8, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88ce52b1-c8, col_values=(('qos', UUID('9fdd1641-139d-4839-892c-81b212440cb7')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88ce52b1-c8, col_values=(('external_ids', {'iface-id': '88ce52b1-c8b7-4958-ad77-4424811b13b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:ab:e0', 'vm-uuid': '0e508411-09db-48b8-98a5-1ccd9f4f6031'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:06 user nova-compute[75018]: INFO os_vif [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ab:e0,bridge_name='br-int',has_traffic_filtering=True,id=88ce52b1-c8b7-4958-ad77-4424811b13b6,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ce52b1-c8')
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:26:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] No VIF found with MAC fa:16:3e:d3:ab:e0, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:26:07 user nova-compute[75018]: DEBUG nova.compute.manager [req-355f4d6e-eb0c-48b7-8339-bdc5eb9449d6 req-d01c3c93-3a5b-4459-8405-3be4b245c9cb service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-plugged-106cd061-e91b-4718-8c52-cbaf14defe8c {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-355f4d6e-eb0c-48b7-8339-bdc5eb9449d6 req-d01c3c93-3a5b-4459-8405-3be4b245c9cb service nova] Acquiring lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-355f4d6e-eb0c-48b7-8339-bdc5eb9449d6 req-d01c3c93-3a5b-4459-8405-3be4b245c9cb service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-355f4d6e-eb0c-48b7-8339-bdc5eb9449d6 req-d01c3c93-3a5b-4459-8405-3be4b245c9cb service nova] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:07 user nova-compute[75018]: DEBUG nova.compute.manager [req-355f4d6e-eb0c-48b7-8339-bdc5eb9449d6 req-d01c3c93-3a5b-4459-8405-3be4b245c9cb service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] No waiting events found dispatching network-vif-plugged-106cd061-e91b-4718-8c52-cbaf14defe8c {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:07 user nova-compute[75018]: WARNING nova.compute.manager [req-355f4d6e-eb0c-48b7-8339-bdc5eb9449d6 req-d01c3c93-3a5b-4459-8405-3be4b245c9cb service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received unexpected event network-vif-plugged-106cd061-e91b-4718-8c52-cbaf14defe8c for instance with vm_state active and task_state deleting.
Nov 07 15:26:07 user nova-compute[75018]: DEBUG nova.compute.manager [req-355f4d6e-eb0c-48b7-8339-bdc5eb9449d6 req-d01c3c93-3a5b-4459-8405-3be4b245c9cb service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Received event network-changed-88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:07 user nova-compute[75018]: DEBUG nova.compute.manager [req-355f4d6e-eb0c-48b7-8339-bdc5eb9449d6 req-d01c3c93-3a5b-4459-8405-3be4b245c9cb service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Refreshing instance network info cache due to event network-changed-88ce52b1-c8b7-4958-ad77-4424811b13b6. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:26:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-355f4d6e-eb0c-48b7-8339-bdc5eb9449d6 req-d01c3c93-3a5b-4459-8405-3be4b245c9cb service nova] Acquiring lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:26:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-355f4d6e-eb0c-48b7-8339-bdc5eb9449d6 req-d01c3c93-3a5b-4459-8405-3be4b245c9cb service nova] Acquired lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:26:07 user nova-compute[75018]: DEBUG nova.network.neutron [req-355f4d6e-eb0c-48b7-8339-bdc5eb9449d6 req-d01c3c93-3a5b-4459-8405-3be4b245c9cb service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Refreshing network info cache for port 88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:26:07 user nova-compute[75018]: DEBUG nova.network.neutron [req-355f4d6e-eb0c-48b7-8339-bdc5eb9449d6 req-d01c3c93-3a5b-4459-8405-3be4b245c9cb service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updated VIF entry in instance network info cache for port 88ce52b1-c8b7-4958-ad77-4424811b13b6. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:26:07 user nova-compute[75018]: DEBUG nova.network.neutron [req-355f4d6e-eb0c-48b7-8339-bdc5eb9449d6 req-d01c3c93-3a5b-4459-8405-3be4b245c9cb service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updating instance_info_cache with network_info: [{"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:26:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-355f4d6e-eb0c-48b7-8339-bdc5eb9449d6 req-d01c3c93-3a5b-4459-8405-3be4b245c9cb service nova] Releasing lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:26:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-621c25ca-700c-4b40-b24a-4f0dcaf72d32 req-4f9ceaee-4a83-4c0c-aea3-69508a5f4808 service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Received event network-vif-plugged-88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-621c25ca-700c-4b40-b24a-4f0dcaf72d32 req-4f9ceaee-4a83-4c0c-aea3-69508a5f4808 service nova] Acquiring lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-621c25ca-700c-4b40-b24a-4f0dcaf72d32 req-4f9ceaee-4a83-4c0c-aea3-69508a5f4808 service nova] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-621c25ca-700c-4b40-b24a-4f0dcaf72d32 req-4f9ceaee-4a83-4c0c-aea3-69508a5f4808 service nova] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-621c25ca-700c-4b40-b24a-4f0dcaf72d32 req-4f9ceaee-4a83-4c0c-aea3-69508a5f4808 service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] No waiting events found dispatching network-vif-plugged-88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:08 user nova-compute[75018]: WARNING nova.compute.manager [req-621c25ca-700c-4b40-b24a-4f0dcaf72d32 req-4f9ceaee-4a83-4c0c-aea3-69508a5f4808 service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Received unexpected event network-vif-plugged-88ce52b1-c8b7-4958-ad77-4424811b13b6 for instance with vm_state building and task_state spawning.
Nov 07 15:26:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-deleted-106cd061-e91b-4718-8c52-cbaf14defe8c {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:09 user nova-compute[75018]: INFO nova.compute.manager [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Neutron deleted interface 106cd061-e91b-4718-8c52-cbaf14defe8c; detaching it from the instance and deleting it from the info cache
Nov 07 15:26:09 user nova-compute[75018]: DEBUG nova.network.neutron [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [{"id": "73054878-c401-487b-8a75-1a637723b058", "address": "fa:16:3e:e7:75:3b", "network": {"id": "b4f2a6c5-feec-4805-869e-2ede50c3990d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1232412547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73054878-c4", "ovs_interfaceid": "73054878-c401-487b-8a75-1a637723b058", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0961679c-4367-4cb0-b7f8-b763408f97c6", "address": "fa:16:3e:4f:9a:a7", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0961679c-43", "ovs_interfaceid": "0961679c-4367-4cb0-b7f8-b763408f97c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "address": "fa:16:3e:e6:8a:29", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda084a72-6e", "ovs_interfaceid": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:26:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Detach interface failed, port_id=106cd061-e91b-4718-8c52-cbaf14defe8c, reason: Instance 44f8bf0d-9714-45cf-8f71-206a8bb75a3a could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:26:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-deleted-73054878-c401-487b-8a75-1a637723b058 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:09 user nova-compute[75018]: INFO nova.compute.manager [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Neutron deleted interface 73054878-c401-487b-8a75-1a637723b058; detaching it from the instance and deleting it from the info cache
Nov 07 15:26:09 user nova-compute[75018]: DEBUG nova.network.neutron [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [{"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0961679c-4367-4cb0-b7f8-b763408f97c6", "address": "fa:16:3e:4f:9a:a7", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0961679c-43", "ovs_interfaceid": "0961679c-4367-4cb0-b7f8-b763408f97c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "address": "fa:16:3e:e6:8a:29", "network": {"id": "5bd166f6-af0c-4a90-8f62-a6c479f18e0d", "bridge": "br-int", "label": "tempest-device-tagging-net2-794862837", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda084a72-6e", "ovs_interfaceid": "da084a72-6ed7-46b9-960e-3f9cd2e0ebf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:26:09 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:26:09 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Took 3.41 seconds to deallocate network for instance.
Nov 07 15:26:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Detach interface failed, port_id=73054878-c401-487b-8a75-1a637723b058, reason: Instance 44f8bf0d-9714-45cf-8f71-206a8bb75a3a could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:26:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-deleted-da084a72-6ed7-46b9-960e-3f9cd2e0ebf6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:09 user nova-compute[75018]: INFO nova.compute.manager [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Neutron deleted interface da084a72-6ed7-46b9-960e-3f9cd2e0ebf6; detaching it from the instance and deleting it from the info cache
Nov 07 15:26:09 user nova-compute[75018]: DEBUG nova.network.neutron [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [{"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0961679c-4367-4cb0-b7f8-b763408f97c6", "address": "fa:16:3e:4f:9a:a7", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0961679c-43", "ovs_interfaceid": "0961679c-4367-4cb0-b7f8-b763408f97c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:26:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Detach interface failed, port_id=da084a72-6ed7-46b9-960e-3f9cd2e0ebf6, reason: Instance 44f8bf0d-9714-45cf-8f71-206a8bb75a3a could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:26:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-deleted-0961679c-4367-4cb0-b7f8-b763408f97c6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:09 user nova-compute[75018]: INFO nova.compute.manager [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Neutron deleted interface 0961679c-4367-4cb0-b7f8-b763408f97c6; detaching it from the instance and deleting it from the info cache
Nov 07 15:26:09 user nova-compute[75018]: DEBUG nova.network.neutron [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [{"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "address": "fa:16:3e:93:fb:92", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e7ee9-58", "ovs_interfaceid": "5a2e7ee9-58c4-46e3-8f31-961dfb488150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:26:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-d1c0f6dd-a2a5-42f6-a1ea-c12b2671f6b8 req-02286aa7-fab1-4b3c-9916-7d69332fdfa8 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Detach interface failed, port_id=0961679c-4367-4cb0-b7f8-b763408f97c6, reason: Instance 44f8bf0d-9714-45cf-8f71-206a8bb75a3a could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:26:10 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Took 4.44 seconds to deallocate network for instance.
Nov 07 15:26:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.compute.manager [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:26:10 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Instance spawned successfully.
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:26:10 user nova-compute[75018]: INFO nova.compute.manager [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Took 6.62 seconds to spawn the instance on the hypervisor.
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.compute.manager [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:26:10 user nova-compute[75018]: INFO nova.compute.manager [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Took 7.77 seconds to build instance.
Nov 07 15:26:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-dd273fb6-302e-4d40-9c98-9a9588b3a0a4 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.880s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4144d755-616e-480a-93b9-7af89b64332a req-c0594d00-1c7e-4a2f-80c2-4498b107bded service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-deleted-82c43c00-84c9-470a-b788-2372caaad4b2 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4144d755-616e-480a-93b9-7af89b64332a req-c0594d00-1c7e-4a2f-80c2-4498b107bded service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Received event network-vif-plugged-88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4144d755-616e-480a-93b9-7af89b64332a req-c0594d00-1c7e-4a2f-80c2-4498b107bded service nova] Acquiring lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4144d755-616e-480a-93b9-7af89b64332a req-c0594d00-1c7e-4a2f-80c2-4498b107bded service nova] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4144d755-616e-480a-93b9-7af89b64332a req-c0594d00-1c7e-4a2f-80c2-4498b107bded service nova] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4144d755-616e-480a-93b9-7af89b64332a req-c0594d00-1c7e-4a2f-80c2-4498b107bded service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] No waiting events found dispatching network-vif-plugged-88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:10 user nova-compute[75018]: WARNING nova.compute.manager [req-4144d755-616e-480a-93b9-7af89b64332a req-c0594d00-1c7e-4a2f-80c2-4498b107bded service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Received unexpected event network-vif-plugged-88ce52b1-c8b7-4958-ad77-4424811b13b6 for instance with vm_state active and task_state None.
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4144d755-616e-480a-93b9-7af89b64332a req-c0594d00-1c7e-4a2f-80c2-4498b107bded service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-deleted-f7d8a867-7f2c-4f73-8521-b2ec3f646045 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4144d755-616e-480a-93b9-7af89b64332a req-c0594d00-1c7e-4a2f-80c2-4498b107bded service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-deleted-af3cc600-3a36-42ec-8976-b1c950150d96 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4144d755-616e-480a-93b9-7af89b64332a req-c0594d00-1c7e-4a2f-80c2-4498b107bded service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-deleted-e606a4ce-7ebe-46db-8e2b-71dc2ee247a1 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4144d755-616e-480a-93b9-7af89b64332a req-c0594d00-1c7e-4a2f-80c2-4498b107bded service nova] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Received event network-vif-deleted-c265f2ff-01fc-4405-81dc-7612ee11764e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-2e5504e6-9386-4780-b7c9-3e539bd6383a req-375b0fd7-71e5-4842-9251-111aac981db2 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Received event network-vif-deleted-5a2e7ee9-58c4-46e3-8f31-961dfb488150 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:11 user nova-compute[75018]: INFO nova.compute.manager [req-2e5504e6-9386-4780-b7c9-3e539bd6383a req-375b0fd7-71e5-4842-9251-111aac981db2 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Neutron deleted interface 5a2e7ee9-58c4-46e3-8f31-961dfb488150; detaching it from the instance and deleting it from the info cache
Nov 07 15:26:11 user nova-compute[75018]: DEBUG nova.network.neutron [req-2e5504e6-9386-4780-b7c9-3e539bd6383a req-375b0fd7-71e5-4842-9251-111aac981db2 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Updating instance_info_cache with network_info: [{"id": "98461dfb-9088-430a-bf24-dd855ff7175b", "address": "fa:16:3e:05:c0:d9", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98461dfb-90", "ovs_interfaceid": "98461dfb-9088-430a-bf24-dd855ff7175b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1383062-7e89-4ca1-a140-27490e36d621", "address": "fa:16:3e:ae:38:52", "network": {"id": "99dfb93a-eb29-4f4c-8312-44505fc44124", "bridge": "br-int", "label": "tempest-device-tagging-net1-286182244", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9973265f38de417c9af4de9eb09ce262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1383062-7e", "ovs_interfaceid": "d1383062-7e89-4ca1-a140-27490e36d621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:26:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-2e5504e6-9386-4780-b7c9-3e539bd6383a req-375b0fd7-71e5-4842-9251-111aac981db2 service nova] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Detach interface failed, port_id=5a2e7ee9-58c4-46e3-8f31-961dfb488150, reason: Instance 44f8bf0d-9714-45cf-8f71-206a8bb75a3a could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:26:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:12 user nova-compute[75018]: INFO nova.compute.manager [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] [instance: 44f8bf0d-9714-45cf-8f71-206a8bb75a3a] Took 2.93 seconds to detach 3 volumes for instance.
Nov 07 15:26:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:12 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:26:12 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:26:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.642s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:13 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Deleted allocations for instance 44f8bf0d-9714-45cf-8f71-206a8bb75a3a
Nov 07 15:26:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4268573d-6b0b-4794-b5e5-abdc7011e5bf tempest-TaggedBootDevicesTest-224611665 tempest-TaggedBootDevicesTest-224611665-project-member] Lock "44f8bf0d-9714-45cf-8f71-206a8bb75a3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.796s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:26:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 15:26:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] There are 0 instances to clean {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 15:26:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:26:17 user nova-compute[75018]: DEBUG nova.compute.manager [req-ac602e78-27c7-473a-a384-044f930e9403 req-f71dd32c-961d-4c5f-ae2e-255b71ae7abc service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-changed-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:17 user nova-compute[75018]: DEBUG nova.compute.manager [req-ac602e78-27c7-473a-a384-044f930e9403 req-f71dd32c-961d-4c5f-ae2e-255b71ae7abc service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Refreshing instance network info cache due to event network-changed-97ce6c8c-ae6c-444d-a746-0c41c90dad44. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:26:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ac602e78-27c7-473a-a384-044f930e9403 req-f71dd32c-961d-4c5f-ae2e-255b71ae7abc service nova] Acquiring lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:26:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ac602e78-27c7-473a-a384-044f930e9403 req-f71dd32c-961d-4c5f-ae2e-255b71ae7abc service nova] Acquired lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:26:17 user nova-compute[75018]: DEBUG nova.network.neutron [req-ac602e78-27c7-473a-a384-044f930e9403 req-f71dd32c-961d-4c5f-ae2e-255b71ae7abc service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Refreshing network info cache for port 97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:26:18 user nova-compute[75018]: DEBUG nova.network.neutron [req-ac602e78-27c7-473a-a384-044f930e9403 req-f71dd32c-961d-4c5f-ae2e-255b71ae7abc service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updated VIF entry in instance network info cache for port 97ce6c8c-ae6c-444d-a746-0c41c90dad44. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:26:18 user nova-compute[75018]: DEBUG nova.network.neutron [req-ac602e78-27c7-473a-a384-044f930e9403 req-f71dd32c-961d-4c5f-ae2e-255b71ae7abc service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updating instance_info_cache with network_info: [{"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:26:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ac602e78-27c7-473a-a384-044f930e9403 req-f71dd32c-961d-4c5f-ae2e-255b71ae7abc service nova] Releasing lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:26:18 user nova-compute[75018]: DEBUG nova.compute.manager [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:26:18 user nova-compute[75018]: INFO nova.compute.manager [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] instance snapshotting
Nov 07 15:26:19 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Beginning live snapshot process
Nov 07 15:26:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json -f qcow2 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json -f qcow2 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json -f qcow2" returned: 0 in 0.257s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.203s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpaphiivm3/4ae2f929ad594e67865f93d21f419ced.delta 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpaphiivm3/4ae2f929ad594e67865f93d21f419ced.delta 1073741824" returned: 0 in 0.056s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:20 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 07 15:26:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:20 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:26:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75018) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 15:26:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] COPY block job progress, current cursor: 28311552 final cursor: 75497472 {{(pid=75018) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 15:26:21 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:26:21 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:26:21 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:26:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75018) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 15:26:22 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 07 15:26:22 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:26:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpaphiivm3/4ae2f929ad594e67865f93d21f419ced.delta /opt/stack/data/nova/instances/snapshots/tmpaphiivm3/4ae2f929ad594e67865f93d21f419ced {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:22 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:26:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpaphiivm3/4ae2f929ad594e67865f93d21f419ced.delta /opt/stack/data/nova/instances/snapshots/tmpaphiivm3/4ae2f929ad594e67865f93d21f419ced" returned: 0 in 0.628s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:22 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Snapshot extracted, beginning image upload
Nov 07 15:26:23 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:26:23 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:26:23 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:26:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:23 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:26:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:23 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:26:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:26:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:25 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Snapshot image upload complete
Nov 07 15:26:25 user nova-compute[75018]: INFO nova.compute.manager [None req-645556da-9407-4e88-8d44-6e81641a5e2f tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Took 7.04 seconds to snapshot the instance on the hypervisor.
Nov 07 15:26:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:26:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:26 user nova-compute[75018]: INFO nova.compute.manager [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] [instance: 934e9b7f-8bb4-4487-83cd-c5fbc92daefc] Took 16.13 seconds to detach 3 volumes for instance.
Nov 07 15:26:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:26 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Refreshing inventories for resource provider 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 15:26:26 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Updating ProviderTree inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 15:26:26 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 15:26:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:26 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Refreshing aggregate associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, aggregates: None {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 15:26:26 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Refreshing trait associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 15:26:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:27 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:26:27 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7740MB free_disk=25.326602935791016GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.968s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.175s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:27 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Deleted allocations for instance 934e9b7f-8bb4-4487-83cd-c5fbc92daefc
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Applying migration context for instance 8257c590-204a-4fde-8487-79b8c0c87ea7 as it has an incoming, in-progress migration 07c5ca07-6454-457d-b35f-9fa944179505. Migration status is finished {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 07 15:26:27 user nova-compute[75018]: INFO nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating resource usage from migration 07c5ca07-6454-457d-b35f-9fa944179505
Nov 07 15:26:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db4f5cbf-42c4-4860-bbcf-502600809347 tempest-TaggedBootDevicesTest_v242-1150033045 tempest-TaggedBootDevicesTest_v242-1150033045-project-member] Lock "934e9b7f-8bb4-4487-83cd-c5fbc92daefc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 28.901s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e3abd70e-baf7-4f13-832c-43696a5ea80c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 5212605c-c913-483f-874b-17af335aeb2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance eb712362-b6b8-4a19-8f5b-8c374d6c4d87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Migration 07c5ca07-6454-457d-b35f-9fa944179505 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8257c590-204a-4fde-8487-79b8c0c87ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance a62fafee-cada-4958-9349-f7771893709f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:26:27 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75018) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 15:26:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:28 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:26:28 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:26:28 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:26:28 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 15:26:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:26:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:26:29 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:26:29 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid 8257c590-204a-4fde-8487-79b8c0c87ea7 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:26:29 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating instance_info_cache with network_info: [{"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:26:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:26:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:26:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:26:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:42 user nova-compute[75018]: DEBUG nova.compute.manager [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:26:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:42 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:26:42 user nova-compute[75018]: INFO nova.compute.claims [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Claim successful on node user
Nov 07 15:26:43 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:26:43 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:26:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG nova.policy [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8af061ec9b2444ecbbc2d1ef913fe558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393342d93e71462eba531f173860d59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:26:43 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Creating image(s)
Nov 07 15:26:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "/opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "/opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "/opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.189s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.208s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk 1073741824" returned: 0 in 0.048s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.185s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG nova.network.neutron [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Successfully created port: 305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Cannot resize image /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Ensure instance console log exists: /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG nova.network.neutron [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Successfully updated port: 305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquired lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG nova.network.neutron [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-257f4a48-63d8-4cc0-b0ac-cd242380b0a9 req-82d1819f-ab1b-45a8-98e6-0d6dee2096da service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-changed-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-257f4a48-63d8-4cc0-b0ac-cd242380b0a9 req-82d1819f-ab1b-45a8-98e6-0d6dee2096da service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Refreshing instance network info cache due to event network-changed-305ed47b-06ed-48aa-9584-70e46a35bded. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-257f4a48-63d8-4cc0-b0ac-cd242380b0a9 req-82d1819f-ab1b-45a8-98e6-0d6dee2096da service nova] Acquiring lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:26:44 user nova-compute[75018]: DEBUG nova.network.neutron [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.network.neutron [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Updating instance_info_cache with network_info: [{"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Releasing lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Instance network_info: |[{"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-257f4a48-63d8-4cc0-b0ac-cd242380b0a9 req-82d1819f-ab1b-45a8-98e6-0d6dee2096da service nova] Acquired lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.network.neutron [req-257f4a48-63d8-4cc0-b0ac-cd242380b0a9 req-82d1819f-ab1b-45a8-98e6-0d6dee2096da service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Refreshing network info cache for port 305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Start _get_guest_xml network_info=[{"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:26:45 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:26:45 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-986489796',display_name='tempest-AttachVolumeTestJSON-server-986489796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-986489796',id=16,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0hEy6Pitp5/KtTEnBNkgUOns4w4ZMcmpTxmXDQ4xItuv4tIAT4CtKyRNJPdDjMXKTP3ENKo04CbmAPNdTPLrhWCvD73ElO9TJ8YQaIuoQSR42PL5M7RpYpZUxIXnp/KA==',key_name='tempest-keypair-1896323243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='393342d93e71462eba531f173860d59f',ramdisk_id='',reservation_id='r-6g6bfllt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1503001538',owner_user_name='tempest-AttachVolumeTestJSON-1503001538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8af061ec9b2444ecbbc2d1ef913fe558',uuid=af83bfa8-3661-4456-8854-f6c457e149fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converting VIF {"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.objects.instance [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'pci_devices' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:26:45 user nova-compute[75018]:   <uuid>af83bfa8-3661-4456-8854-f6c457e149fa</uuid>
Nov 07 15:26:45 user nova-compute[75018]:   <name>instance-00000010</name>
Nov 07 15:26:45 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:26:45 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:26:45 user nova-compute[75018]:   <metadata>
Nov 07 15:26:45 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:26:45 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:26:45 user nova-compute[75018]:       <nova:name>tempest-AttachVolumeTestJSON-server-986489796</nova:name>
Nov 07 15:26:45 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:26:45</nova:creationTime>
Nov 07 15:26:45 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:26:45 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:26:45 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:26:45 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:26:45 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:26:45 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:26:45 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:26:45 user nova-compute[75018]:       <nova:owner>
Nov 07 15:26:45 user nova-compute[75018]:         <nova:user uuid="8af061ec9b2444ecbbc2d1ef913fe558">tempest-AttachVolumeTestJSON-1503001538-project-member</nova:user>
Nov 07 15:26:45 user nova-compute[75018]:         <nova:project uuid="393342d93e71462eba531f173860d59f">tempest-AttachVolumeTestJSON-1503001538</nova:project>
Nov 07 15:26:45 user nova-compute[75018]:       </nova:owner>
Nov 07 15:26:45 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:26:45 user nova-compute[75018]:       <nova:ports>
Nov 07 15:26:45 user nova-compute[75018]:         <nova:port uuid="305ed47b-06ed-48aa-9584-70e46a35bded">
Nov 07 15:26:45 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 15:26:45 user nova-compute[75018]:         </nova:port>
Nov 07 15:26:45 user nova-compute[75018]:       </nova:ports>
Nov 07 15:26:45 user nova-compute[75018]:     </nova:instance>
Nov 07 15:26:45 user nova-compute[75018]:   </metadata>
Nov 07 15:26:45 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:26:45 user nova-compute[75018]:     <system>
Nov 07 15:26:45 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:26:45 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:26:45 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:26:45 user nova-compute[75018]:       <entry name="serial">af83bfa8-3661-4456-8854-f6c457e149fa</entry>
Nov 07 15:26:45 user nova-compute[75018]:       <entry name="uuid">af83bfa8-3661-4456-8854-f6c457e149fa</entry>
Nov 07 15:26:45 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:26:45 user nova-compute[75018]:     </system>
Nov 07 15:26:45 user nova-compute[75018]:   </sysinfo>
Nov 07 15:26:45 user nova-compute[75018]:   <os>
Nov 07 15:26:45 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:26:45 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:26:45 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:26:45 user nova-compute[75018]:   </os>
Nov 07 15:26:45 user nova-compute[75018]:   <features>
Nov 07 15:26:45 user nova-compute[75018]:     <acpi/>
Nov 07 15:26:45 user nova-compute[75018]:     <apic/>
Nov 07 15:26:45 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:26:45 user nova-compute[75018]:   </features>
Nov 07 15:26:45 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:26:45 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:26:45 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:26:45 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:26:45 user nova-compute[75018]:   </clock>
Nov 07 15:26:45 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:26:45 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:26:45 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:26:45 user nova-compute[75018]:   </cpu>
Nov 07 15:26:45 user nova-compute[75018]:   <devices>
Nov 07 15:26:45 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:26:45 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:26:45 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk"/>
Nov 07 15:26:45 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:26:45 user nova-compute[75018]:     </disk>
Nov 07 15:26:45 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:26:45 user nova-compute[75018]:       <mac address="fa:16:3e:f8:80:43"/>
Nov 07 15:26:45 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:26:45 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:26:45 user nova-compute[75018]:       <target dev="tap305ed47b-06"/>
Nov 07 15:26:45 user nova-compute[75018]:     </interface>
Nov 07 15:26:45 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:26:45 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/console.log" append="off"/>
Nov 07 15:26:45 user nova-compute[75018]:     </serial>
Nov 07 15:26:45 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:26:45 user nova-compute[75018]:     <video>
Nov 07 15:26:45 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:26:45 user nova-compute[75018]:     </video>
Nov 07 15:26:45 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:26:45 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:26:45 user nova-compute[75018]:     </rng>
Nov 07 15:26:45 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:26:45 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:26:45 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:26:45 user nova-compute[75018]:     </memballoon>
Nov 07 15:26:45 user nova-compute[75018]:   </devices>
Nov 07 15:26:45 user nova-compute[75018]: </domain>
Nov 07 15:26:45 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-986489796',display_name='tempest-AttachVolumeTestJSON-server-986489796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-986489796',id=16,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0hEy6Pitp5/KtTEnBNkgUOns4w4ZMcmpTxmXDQ4xItuv4tIAT4CtKyRNJPdDjMXKTP3ENKo04CbmAPNdTPLrhWCvD73ElO9TJ8YQaIuoQSR42PL5M7RpYpZUxIXnp/KA==',key_name='tempest-keypair-1896323243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='393342d93e71462eba531f173860d59f',ramdisk_id='',reservation_id='r-6g6bfllt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1503001538',owner_user_name='tempest-AttachVolumeTestJSON-1503001538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8af061ec9b2444ecbbc2d1ef913fe558',uuid=af83bfa8-3661-4456-8854-f6c457e149fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converting VIF {"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG os_vif [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4643f90b-2904-5517-bad1-583bfdc19724', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap305ed47b-06, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap305ed47b-06, col_values=(('qos', UUID('f798110b-9d08-4f26-ae4e-5627c3023817')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap305ed47b-06, col_values=(('external_ids', {'iface-id': '305ed47b-06ed-48aa-9584-70e46a35bded', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:80:43', 'vm-uuid': 'af83bfa8-3661-4456-8854-f6c457e149fa'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:45 user nova-compute[75018]: INFO os_vif [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06')
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] No VIF found with MAC fa:16:3e:f8:80:43, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.network.neutron [req-257f4a48-63d8-4cc0-b0ac-cd242380b0a9 req-82d1819f-ab1b-45a8-98e6-0d6dee2096da service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Updated VIF entry in instance network info cache for port 305ed47b-06ed-48aa-9584-70e46a35bded. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG nova.network.neutron [req-257f4a48-63d8-4cc0-b0ac-cd242380b0a9 req-82d1819f-ab1b-45a8-98e6-0d6dee2096da service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Updating instance_info_cache with network_info: [{"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:26:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-257f4a48-63d8-4cc0-b0ac-cd242380b0a9 req-82d1819f-ab1b-45a8-98e6-0d6dee2096da service nova] Releasing lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:26:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:46 user nova-compute[75018]: DEBUG nova.compute.manager [req-b927f316-bb9b-4424-bd1c-cf068587d201 req-1f1e9b4c-8f2f-458b-856e-7c7d62cc600a service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b927f316-bb9b-4424-bd1c-cf068587d201 req-1f1e9b4c-8f2f-458b-856e-7c7d62cc600a service nova] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b927f316-bb9b-4424-bd1c-cf068587d201 req-1f1e9b4c-8f2f-458b-856e-7c7d62cc600a service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b927f316-bb9b-4424-bd1c-cf068587d201 req-1f1e9b4c-8f2f-458b-856e-7c7d62cc600a service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:46 user nova-compute[75018]: DEBUG nova.compute.manager [req-b927f316-bb9b-4424-bd1c-cf068587d201 req-1f1e9b4c-8f2f-458b-856e-7c7d62cc600a service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] No waiting events found dispatching network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:46 user nova-compute[75018]: WARNING nova.compute.manager [req-b927f316-bb9b-4424-bd1c-cf068587d201 req-1f1e9b4c-8f2f-458b-856e-7c7d62cc600a service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received unexpected event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded for instance with vm_state building and task_state spawning.
Nov 07 15:26:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-09161a2d-73ed-4de7-88e5-631b8bd92f66 req-0252a61c-80bf-4aef-96d5-d3bfc9bc5d84 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:26:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-09161a2d-73ed-4de7-88e5-631b8bd92f66 req-0252a61c-80bf-4aef-96d5-d3bfc9bc5d84 service nova] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-09161a2d-73ed-4de7-88e5-631b8bd92f66 req-0252a61c-80bf-4aef-96d5-d3bfc9bc5d84 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-09161a2d-73ed-4de7-88e5-631b8bd92f66 req-0252a61c-80bf-4aef-96d5-d3bfc9bc5d84 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-09161a2d-73ed-4de7-88e5-631b8bd92f66 req-0252a61c-80bf-4aef-96d5-d3bfc9bc5d84 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] No waiting events found dispatching network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:26:49 user nova-compute[75018]: WARNING nova.compute.manager [req-09161a2d-73ed-4de7-88e5-631b8bd92f66 req-0252a61c-80bf-4aef-96d5-d3bfc9bc5d84 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received unexpected event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded for instance with vm_state building and task_state spawning.
Nov 07 15:26:49 user nova-compute[75018]: DEBUG nova.compute.manager [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:26:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:26:49 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Instance spawned successfully.
Nov 07 15:26:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:26:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:26:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:26:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:26:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:26:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:26:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:26:49 user nova-compute[75018]: INFO nova.compute.manager [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 07 15:26:49 user nova-compute[75018]: DEBUG nova.compute.manager [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:26:49 user nova-compute[75018]: INFO nova.compute.manager [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Took 6.55 seconds to build instance.
Nov 07 15:26:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-71d0a20d-b6c3-4ec0-b3bf-156ce74d397a tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.657s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:26:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:26:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:26:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:26:58 user nova-compute[75018]: INFO nova.compute.manager [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Detaching volume a827c6fb-5214-4b8c-ba79-b9b1923cc8f6
Nov 07 15:26:58 user nova-compute[75018]: INFO nova.virt.block_device [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Attempting to driver detach volume a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 from mountpoint /dev/vdc
Nov 07 15:26:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Attempting to detach device vdc from instance eb712362-b6b8-4a19-8f5b-8c374d6c4d87 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:26:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:26:58 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:26:58 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:26:58 user nova-compute[75018]:   <target dev="vdc" bus="virtio"/>
Nov 07 15:26:58 user nova-compute[75018]:   <serial>a827c6fb-5214-4b8c-ba79-b9b1923cc8f6</serial>
Nov 07 15:26:58 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 15:26:58 user nova-compute[75018]: </disk>
Nov 07 15:26:58 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:26:58 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Successfully detached device vdc from instance eb712362-b6b8-4a19-8f5b-8c374d6c4d87 from the persistent domain config.
Nov 07 15:26:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance eb712362-b6b8-4a19-8f5b-8c374d6c4d87 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:26:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:26:58 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:26:58 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:26:58 user nova-compute[75018]:   <target dev="vdc" bus="virtio"/>
Nov 07 15:26:58 user nova-compute[75018]:   <serial>a827c6fb-5214-4b8c-ba79-b9b1923cc8f6</serial>
Nov 07 15:26:58 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 15:26:58 user nova-compute[75018]: </disk>
Nov 07 15:26:58 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:26:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance eb712362-b6b8-4a19-8f5b-8c374d6c4d87 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:27:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "a62fafee-cada-4958-9349-f7771893709f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "a62fafee-cada-4958-9349-f7771893709f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "a62fafee-cada-4958-9349-f7771893709f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "a62fafee-cada-4958-9349-f7771893709f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "a62fafee-cada-4958-9349-f7771893709f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:10 user nova-compute[75018]: INFO nova.compute.manager [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Terminating instance
Nov 07 15:27:10 user nova-compute[75018]: DEBUG nova.compute.manager [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-0d036421-7797-4b0d-a271-ef97f4439bf7 req-308d0d1f-f000-42bd-a0bb-8d9d1bc24afb service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] Received event network-vif-unplugged-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0d036421-7797-4b0d-a271-ef97f4439bf7 req-308d0d1f-f000-42bd-a0bb-8d9d1bc24afb service nova] Acquiring lock "a62fafee-cada-4958-9349-f7771893709f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0d036421-7797-4b0d-a271-ef97f4439bf7 req-308d0d1f-f000-42bd-a0bb-8d9d1bc24afb service nova] Lock "a62fafee-cada-4958-9349-f7771893709f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0d036421-7797-4b0d-a271-ef97f4439bf7 req-308d0d1f-f000-42bd-a0bb-8d9d1bc24afb service nova] Lock "a62fafee-cada-4958-9349-f7771893709f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-0d036421-7797-4b0d-a271-ef97f4439bf7 req-308d0d1f-f000-42bd-a0bb-8d9d1bc24afb service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] No waiting events found dispatching network-vif-unplugged-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-0d036421-7797-4b0d-a271-ef97f4439bf7 req-308d0d1f-f000-42bd-a0bb-8d9d1bc24afb service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] Received event network-vif-unplugged-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:27:10 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: a62fafee-cada-4958-9349-f7771893709f] Instance destroyed successfully.
Nov 07 15:27:10 user nova-compute[75018]: DEBUG nova.objects.instance [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lazy-loading 'resources' on Instance uuid a62fafee-cada-4958-9349-f7771893709f {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-930712938',display_name='tempest-VolumesAdminNegativeTest-server-930712938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-930712938',id=14,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:25:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27fbe1a7764e40a3ba9fc1f02c183b50',ramdisk_id='',reservation_id='r-g8eys4a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-617339332',owner_user_name='tempest-VolumesAdminNegativeTest-617339332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:25:06Z,user_data=None,user_id='7d4b199a80014b9e8b931ee04376c693',uuid=a62fafee-cada-4958-9349-f7771893709f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "address": "fa:16:3e:19:16:9a", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a2b6e3-8d", "ovs_interfaceid": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Converting VIF {"id": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "address": "fa:16:3e:19:16:9a", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a2b6e3-8d", "ovs_interfaceid": "75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:16:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8,network=Network(fc935020-27d6-4ac8-9e8e-6fa65590da1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a2b6e3-8d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG os_vif [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:16:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8,network=Network(fc935020-27d6-4ac8-9e8e-6fa65590da1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a2b6e3-8d') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75a2b6e3-8d, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5b1b780-b762-49de-82be-9f200c2aa05b) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:27:10 user nova-compute[75018]: INFO os_vif [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:16:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8,network=Network(fc935020-27d6-4ac8-9e8e-6fa65590da1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a2b6e3-8d')
Nov 07 15:27:10 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Deleting instance files /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f_del
Nov 07 15:27:10 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Deletion of /opt/stack/data/nova/instances/a62fafee-cada-4958-9349-f7771893709f_del complete
Nov 07 15:27:11 user nova-compute[75018]: INFO nova.compute.manager [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: a62fafee-cada-4958-9349-f7771893709f] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: a62fafee-cada-4958-9349-f7771893709f] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: a62fafee-cada-4958-9349-f7771893709f] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: a62fafee-cada-4958-9349-f7771893709f] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:27:11 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: a62fafee-cada-4958-9349-f7771893709f] Took 0.55 seconds to deallocate network for instance.
Nov 07 15:27:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-ffe38871-ce0f-422b-9f00-94f715538287 req-38016d24-3858-4302-b7eb-b4045e12b413 service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] Received event network-vif-deleted-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:27:11 user nova-compute[75018]: WARNING nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] While synchronizing instance power states, found 9 instances in the database and 7 instances on the hypervisor.
Nov 07 15:27:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 8257c590-204a-4fde-8487-79b8c0c87ea7 {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid eb712362-b6b8-4a19-8f5b-8c374d6c4d87 {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid e3abd70e-baf7-4f13-832c-43696a5ea80c {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 5212605c-c913-483f-874b-17af335aeb2f {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid a62fafee-cada-4958-9349-f7771893709f {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 0e508411-09db-48b8-98a5-1ccd9f4f6031 {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "5212605c-c913-483f-874b-17af335aeb2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "5212605c-c913-483f-874b-17af335aeb2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "a62fafee-cada-4958-9349-f7771893709f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "0e508411-09db-48b8-98a5-1ccd9f4f6031" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:11 user nova-compute[75018]: INFO nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 5212605c-c913-483f-874b-17af335aeb2f] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Nov 07 15:27:11 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:27:12 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:27:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:12 user nova-compute[75018]: WARNING nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Instance is unexpectedly not found. Ignore.
Nov 07 15:27:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "5212605c-c913-483f-874b-17af335aeb2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.184s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:12 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Deleted allocations for instance a62fafee-cada-4958-9349-f7771893709f
Nov 07 15:27:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69e99366-f117-4ccf-9645-ea3a3d1ffd01 tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "a62fafee-cada-4958-9349-f7771893709f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.108s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "a62fafee-cada-4958-9349-f7771893709f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.328s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "a62fafee-cada-4958-9349-f7771893709f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:12 user nova-compute[75018]: DEBUG nova.compute.manager [req-c7ef1ef2-a581-4bc5-b473-66797b71404d req-50d4abf5-3e81-4833-bcfd-cd77e2c33006 service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] Received event network-vif-plugged-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:27:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c7ef1ef2-a581-4bc5-b473-66797b71404d req-50d4abf5-3e81-4833-bcfd-cd77e2c33006 service nova] Acquiring lock "a62fafee-cada-4958-9349-f7771893709f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c7ef1ef2-a581-4bc5-b473-66797b71404d req-50d4abf5-3e81-4833-bcfd-cd77e2c33006 service nova] Lock "a62fafee-cada-4958-9349-f7771893709f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c7ef1ef2-a581-4bc5-b473-66797b71404d req-50d4abf5-3e81-4833-bcfd-cd77e2c33006 service nova] Lock "a62fafee-cada-4958-9349-f7771893709f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:12 user nova-compute[75018]: DEBUG nova.compute.manager [req-c7ef1ef2-a581-4bc5-b473-66797b71404d req-50d4abf5-3e81-4833-bcfd-cd77e2c33006 service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] No waiting events found dispatching network-vif-plugged-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:27:12 user nova-compute[75018]: WARNING nova.compute.manager [req-c7ef1ef2-a581-4bc5-b473-66797b71404d req-50d4abf5-3e81-4833-bcfd-cd77e2c33006 service nova] [instance: a62fafee-cada-4958-9349-f7771893709f] Received unexpected event network-vif-plugged-75a2b6e3-8d2a-4bdb-b65b-3da60ac926f8 for instance with vm_state deleted and task_state None.
Nov 07 15:27:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:19 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance eb712362-b6b8-4a19-8f5b-8c374d6c4d87 is timed out.
Nov 07 15:27:19 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Successfully detached device vdc from instance eb712362-b6b8-4a19-8f5b-8c374d6c4d87 from the live domain config.
Nov 07 15:27:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKFozdfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:27:19 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9054a48-1afa-4d62-b04e-9a9cf1d47846]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:27:19 user nova-compute[75018]: No targets found.
Nov 07 15:27:19 user nova-compute[75018]: iSNS:
Nov 07 15:27:19 user nova-compute[75018]: No targets found.
Nov 07 15:27:19 user nova-compute[75018]: STATIC:
Nov 07 15:27:19 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6
Nov 07 15:27:19 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:27:19 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:27:19 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:27:19 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:27:19 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:27:19 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf
Nov 07 15:27:19 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:27:19 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:27:19 user nova-compute[75018]: FIRMWARE:
Nov 07 15:27:19 user nova-compute[75018]: No targets found.
Nov 07 15:27:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:27:19 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:27:19 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[66da3fe9-80f3-40d9-867e-e36aded2d334]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6043ab5f-613a-4e59-a73a-06fdadb2a6cf]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:27:19 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:27:19 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:27:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 (non-flash)
Nov 07 15:27:19 user nova-compute[75018]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:27:19 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:27:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae04e9fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6'): ({'sdd'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Removing single pathed devices sdd {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[12630b6b-0b89-48d3-89aa-d9814d28e1d8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5816bc0b-8e1b-4d9c-968b-427e3dfcf9ea]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Flushing IO for device /dev/sdd {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fed6957-8a4d-415d-97c2-cdc5c1fc5a43]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f28569-1794-4ac6-8b3e-90583169fb0e]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf5662e-9e98-415b-940c-1cedc3d937fa]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefa9e35-771f-40b4-b020-f179fb701841]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6, portal: 172.16.0.220,3260]
Nov 07 15:27:19 user nova-compute[75018]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6, portal: 172.16.0.220,3260] successful.
Nov 07 15:27:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a827c6fb-5214-4b8c-ba79-b9b1923cc8f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc41059d-6bc7-47bc-ac7f-59ada858b716]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] <== disconnect_volume: return (325ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:27:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:27:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:20 user nova-compute[75018]: DEBUG nova.objects.instance [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'flavor' on Instance uuid eb712362-b6b8-4a19-8f5b-8c374d6c4d87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:27:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-32668568-c457-445f-a03c-bad4677c0af3 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.035s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.027s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:21 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:27:21 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:27:21 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:27:22 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:27:23 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:27:24 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:27:24 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:27:24 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:27:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:24 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:27:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:27:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:27:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:27 user nova-compute[75018]: INFO nova.compute.manager [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Detaching volume cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:27:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:27 user nova-compute[75018]: INFO nova.virt.block_device [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Attempting to driver detach volume cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 from mountpoint /dev/vdb
Nov 07 15:27:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Attempting to detach device vdb from instance e3abd70e-baf7-4f13-832c-43696a5ea80c from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:27:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:27:27 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:27:27 user nova-compute[75018]:   <source dev="/dev/sdf"/>
Nov 07 15:27:27 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:27:27 user nova-compute[75018]:   <serial>cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4</serial>
Nov 07 15:27:27 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:27:27 user nova-compute[75018]: </disk>
Nov 07 15:27:27 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:27:27 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Successfully detached device vdb from instance e3abd70e-baf7-4f13-832c-43696a5ea80c from the persistent domain config.
Nov 07 15:27:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3abd70e-baf7-4f13-832c-43696a5ea80c from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:27:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:27:27 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:27:27 user nova-compute[75018]:   <source dev="/dev/sdf"/>
Nov 07 15:27:27 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:27:27 user nova-compute[75018]:   <serial>cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4</serial>
Nov 07 15:27:27 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:27:27 user nova-compute[75018]: </disk>
Nov 07 15:27:27 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:27:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3abd70e-baf7-4f13-832c-43696a5ea80c {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:27:27 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:27:27 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:27:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7747MB free_disk=25.283939361572266GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:27:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Applying migration context for instance 8257c590-204a-4fde-8487-79b8c0c87ea7 as it has an incoming, in-progress migration 07c5ca07-6454-457d-b35f-9fa944179505. Migration status is finished {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 07 15:27:28 user nova-compute[75018]: INFO nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating resource usage from migration 07c5ca07-6454-457d-b35f-9fa944179505
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e3abd70e-baf7-4f13-832c-43696a5ea80c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 5212605c-c913-483f-874b-17af335aeb2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance eb712362-b6b8-4a19-8f5b-8c374d6c4d87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Migration 07c5ca07-6454-457d-b35f-9fa944179505 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8257c590-204a-4fde-8487-79b8c0c87ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance af83bfa8-3661-4456-8854-f6c457e149fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:27:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:27:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:27:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:27:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:27:29 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:27:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updating instance_info_cache with network_info: [{"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:27:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-eb712362-b6b8-4a19-8f5b-8c374d6c4d87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:27:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:27:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:27:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:34 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Port 05429ce8-06b2-4693-bf2c-5d03a4343e00 binding to destination host user is already ACTIVE {{(pid=75018) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 07 15:27:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:27:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquired lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:27:34 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:27:34 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating instance_info_cache with network_info: [{"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:27:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Releasing lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:27:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Creating tmpfile /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/tmpjgt9aw58 to verify with other compute node that the instance is on the same shared storage. {{(pid=75018) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 07 15:27:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-815c87b3-974a-4123-b797-f4bca90ebe89 req-e67c5f77-f242-4454-bd44-f42551912bc6 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-vif-unplugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-815c87b3-974a-4123-b797-f4bca90ebe89 req-e67c5f77-f242-4454-bd44-f42551912bc6 service nova] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-815c87b3-974a-4123-b797-f4bca90ebe89 req-e67c5f77-f242-4454-bd44-f42551912bc6 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-815c87b3-974a-4123-b797-f4bca90ebe89 req-e67c5f77-f242-4454-bd44-f42551912bc6 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-815c87b3-974a-4123-b797-f4bca90ebe89 req-e67c5f77-f242-4454-bd44-f42551912bc6 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] No waiting events found dispatching network-vif-unplugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:27:35 user nova-compute[75018]: WARNING nova.compute.manager [req-815c87b3-974a-4123-b797-f4bca90ebe89 req-e67c5f77-f242-4454-bd44-f42551912bc6 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received unexpected event network-vif-unplugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 for instance with vm_state resized and task_state resize_reverting.
Nov 07 15:27:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:35 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Instance destroyed successfully.
Nov 07 15:27:35 user nova-compute[75018]: DEBUG nova.objects.instance [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lazy-loading 'resources' on Instance uuid 8257c590-204a-4fde-8487-79b8c0c87ea7 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077045494',display_name='tempest-ServerActionsTestOtherB-server-2077045494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077045494',id=1,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyBOTPm1HGMtOU1eTQJ9qDH8GeBUu2t+LNMgZBFFRP6tXXqDAukKUUiPODmfxQ+bXcX5mB9tkmMwlkDaHeyRpZSXxAXFTca2PcoYOgGrbYpszpri/wTQI3HjvvfuDY7fQ==',key_name='tempest-keypair-1660361084',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:25:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='585cee0db41e41dda7f10ecfc90f1daf',ramdisk_id='',reservation_id='r-rh7e0y4o',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1343289164',owner_user_name='tempest-ServerActionsTestOtherB-1343289164-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:25:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b867fc1e0742c3a3c5b76ed6fb756e',uuid=8257c590-204a-4fde-8487-79b8c0c87ea7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converting VIF {"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_vif [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05429ce8-06, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69eddc2a-4905-43bc-aab7-d3d0c3959e5c) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:35 user nova-compute[75018]: INFO os_vif [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06')
Nov 07 15:27:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUpZxbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:27:35 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94de0cb-3765-490f-b670-51c159fce6f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:27:35 user nova-compute[75018]: No targets found.
Nov 07 15:27:35 user nova-compute[75018]: iSNS:
Nov 07 15:27:35 user nova-compute[75018]: No targets found.
Nov 07 15:27:35 user nova-compute[75018]: STATIC:
Nov 07 15:27:35 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:27:35 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:27:35 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:27:35 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf
Nov 07 15:27:35 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:27:35 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:27:35 user nova-compute[75018]: FIRMWARE:
Nov 07 15:27:35 user nova-compute[75018]: No targets found.
Nov 07 15:27:35 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:27:35 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:27:35 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee4f961-e82d-4b60-8c55-f279289a371f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f494ec-9884-49bc-b13d-6a2c858e544b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:27:35 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:27:35 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:27:35 user nova-compute[75018]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:27:35 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae06a9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf'): ({'sdc'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Removing single pathed devices sdc {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c230e675-69e3-4f67-b9e4-1410106a22a3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b26ac8-d9ff-4446-a2cd-dd004f54c19f]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Flushing IO for device /dev/sdc {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0bcc27-8ab3-466b-bd9b-9558ffa138a5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6f6544-c917-4cf8-ae52-671114aa78ba]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01a6c38-0e69-402e-b040-ea515abc22ca]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39e410f-9526-42ae-ab0c-2ad2aa1f8e76]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260]
Nov 07 15:27:35 user nova-compute[75018]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260] successful.
Nov 07 15:27:35 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbd2157-cf99-4d23-818a-e66f8fb1cdd5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] <== disconnect_volume: return (332ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:27:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:27:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:37 user nova-compute[75018]: DEBUG nova.objects.instance [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lazy-loading 'migration_context' on Instance uuid 8257c590-204a-4fde-8487-79b8c0c87ea7 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:27:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:37 user nova-compute[75018]: DEBUG nova.objects.base [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Object Instance<8257c590-204a-4fde-8487-79b8c0c87ea7> lazy-loaded attributes: resources,migration_context {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:27:37 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:27:37 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:27:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.439s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-cf7393ff-864a-47f4-8e5c-13bc93e36cfa req-7320239b-8acb-455c-a375-19863d1da976 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:27:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cf7393ff-864a-47f4-8e5c-13bc93e36cfa req-7320239b-8acb-455c-a375-19863d1da976 service nova] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cf7393ff-864a-47f4-8e5c-13bc93e36cfa req-7320239b-8acb-455c-a375-19863d1da976 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cf7393ff-864a-47f4-8e5c-13bc93e36cfa req-7320239b-8acb-455c-a375-19863d1da976 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-cf7393ff-864a-47f4-8e5c-13bc93e36cfa req-7320239b-8acb-455c-a375-19863d1da976 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] No waiting events found dispatching network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:27:37 user nova-compute[75018]: WARNING nova.compute.manager [req-cf7393ff-864a-47f4-8e5c-13bc93e36cfa req-7320239b-8acb-455c-a375-19863d1da976 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received unexpected event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 for instance with vm_state resized and task_state resize_reverting.
Nov 07 15:27:38 user nova-compute[75018]: INFO nova.compute.manager [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Swapping old allocation on dict_keys(['54e83767-2936-4d0e-a90c-1dd381218079']) held by migration 07c5ca07-6454-457d-b35f-9fa944179505 for instance
Nov 07 15:27:38 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Overwriting current allocation {'allocations': {'54e83767-2936-4d0e-a90c-1dd381218079': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': '585cee0db41e41dda7f10ecfc90f1daf', 'user_id': 'c6b867fc1e0742c3a3c5b76ed6fb756e', 'consumer_generation': 1} on consumer 8257c590-204a-4fde-8487-79b8c0c87ea7 {{(pid=75018) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 07 15:27:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:27:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquired lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:27:38 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating instance_info_cache with network_info: [{"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Releasing lock "refresh_cache-8257c590-204a-4fde-8487-79b8c0c87ea7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG os_brick.utils [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6657c92-9d9a-447b-8aed-9a2c49685d9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec9a8ee-9871-4b3c-bf2f-bcbe378e3d8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[09db94f6-d7df-44f5-bb91-5ab3bd022621]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d94ebe-4324-40c5-b674-ace7d98d3350]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:27:39 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:27:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6270649c-b3dd-454a-9307-24eda2914324]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:27:39 user nova-compute[75018]: DEBUG os_brick.utils [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:27:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:47 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e3abd70e-baf7-4f13-832c-43696a5ea80c is timed out.
Nov 07 15:27:47 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Successfully detached device vdb from instance e3abd70e-baf7-4f13-832c-43696a5ea80c from the live domain config.
Nov 07 15:27:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:27:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgmzSRQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:27:47 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:27:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:27:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:27:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[44287e03-e6e5-4ae6-ab33-176d8230b55c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:27:48 user nova-compute[75018]: No targets found.
Nov 07 15:27:48 user nova-compute[75018]: iSNS:
Nov 07 15:27:48 user nova-compute[75018]: No targets found.
Nov 07 15:27:48 user nova-compute[75018]: STATIC:
Nov 07 15:27:48 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4
Nov 07 15:27:48 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:27:48 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:27:48 user nova-compute[75018]: FIRMWARE:
Nov 07 15:27:48 user nova-compute[75018]: No targets found.
Nov 07 15:27:48 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:27:48 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:27:48 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa70e896-a658-446b-8131-ba6841f2ec7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4595ce38-b838-4eee-bfce-adc5cef4d1fb]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:27:48 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 (non-flash)
Nov 07 15:27:48 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae05001f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4'): ({'sdf'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Removing single pathed devices sdf {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c8a1d9-590f-4de6-baca-34201a04971a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0c73e9-02bf-4fe7-bc8e-184466d622ff]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Flushing IO for device /dev/sdf {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[70883d41-a006-4a71-8225-387a14ce81af]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.139s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cd22b7-ba83-4fad-bdfc-0c98500d129e]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] SCSI volumes sdf have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.049s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[04da6ea6-4f3a-4556-a2be-45f5e631bb09]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84b253b-9685-493c-b7a5-53a4c07003c2]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4, portal: 172.16.0.220,3260]
Nov 07 15:27:48 user nova-compute[75018]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4, portal: 172.16.0.220,3260] successful.
Nov 07 15:27:48 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3bc371-9aa7-4bfe-84dc-0e0e3b26fab4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c53f1a8-26fa-4c48-8a13-1af977678937]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.454s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] <== disconnect_volume: return (456ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:27:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:49 user nova-compute[75018]: INFO nova.compute.manager [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Terminating instance
Nov 07 15:27:49 user nova-compute[75018]: DEBUG nova.compute.manager [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lazy-loading 'flavor' on Instance uuid e3abd70e-baf7-4f13-832c-43696a5ea80c {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-01485988-7248-425a-9cc4-ecce77f6b035 req-1463cbfe-4e0c-44ad-b665-e545b134baef service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received event network-vif-unplugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-01485988-7248-425a-9cc4-ecce77f6b035 req-1463cbfe-4e0c-44ad-b665-e545b134baef service nova] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-01485988-7248-425a-9cc4-ecce77f6b035 req-1463cbfe-4e0c-44ad-b665-e545b134baef service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-01485988-7248-425a-9cc4-ecce77f6b035 req-1463cbfe-4e0c-44ad-b665-e545b134baef service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-01485988-7248-425a-9cc4-ecce77f6b035 req-1463cbfe-4e0c-44ad-b665-e545b134baef service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] No waiting events found dispatching network-vif-unplugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-01485988-7248-425a-9cc4-ecce77f6b035 req-1463cbfe-4e0c-44ad-b665-e545b134baef service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received event network-vif-unplugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:27:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c1d0cd07-76e8-46cb-a68e-ca005966142e tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.690s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Instance destroyed successfully.
Nov 07 15:27:50 user nova-compute[75018]: DEBUG nova.objects.instance [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'resources' on Instance uuid eb712362-b6b8-4a19-8f5b-8c374d6c4d87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1081479971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1081479971',id=2,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGjOU9EW2aSTQ6LThOiRDF4utalg+tsviiM8orNc2RM3jBR/IYDksyXS2IStjIBlycILbeNViTcf4xQGQHqvqFePxwxGgPLyqjutal2484sVd/KwplLIrUEg+FkltYxhg==',key_name='tempest-keypair-376302873',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:25:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1d8e2c039d94beea94f85d8d5a95d95',ramdisk_id='',reservation_id='r-hbv005jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-175335890',owner_user_name='tempest-AttachVolumeShelveTestJSON-175335890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c7596f1e0e748728fa459908f89aede',uuid=eb712362-b6b8-4a19-8f5b-8c374d6c4d87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converting VIF {"id": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "address": "fa:16:3e:be:3f:d4", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7fccd97-1d", "ovs_interfaceid": "d7fccd97-1db7-4dac-b2e9-6d5b4004aa70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d7fccd97-1db7-4dac-b2e9-6d5b4004aa70,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7fccd97-1d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG os_vif [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d7fccd97-1db7-4dac-b2e9-6d5b4004aa70,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7fccd97-1d') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7fccd97-1d, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1e29e22-592f-44f1-9a82-cd4765720d48) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:50 user nova-compute[75018]: INFO os_vif [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d7fccd97-1db7-4dac-b2e9-6d5b4004aa70,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7fccd97-1d')
Nov 07 15:27:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Deleting instance files /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87_del
Nov 07 15:27:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Deletion of /opt/stack/data/nova/instances/eb712362-b6b8-4a19-8f5b-8c374d6c4d87_del complete
Nov 07 15:27:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:50 user nova-compute[75018]: INFO nova.compute.manager [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 07 15:27:50 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:27:50 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:27:51 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Took 0.75 seconds to deallocate network for instance.
Nov 07 15:27:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-3adfbc8a-d7f1-4e62-aa2b-6f1aa84fc4b2 req-7a202697-4a62-4f8c-88b0-c097927250a8 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received event network-vif-deleted-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:51 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Deleted allocations for instance eb712362-b6b8-4a19-8f5b-8c374d6c4d87
Nov 07 15:27:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56e99e89-acc4-4ae4-825d-1d09e3a1a904 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.325s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-846d7859-2f71-47e8-b4ae-9fa71602c264 req-5403b5ef-3833-4d0e-a3e1-56cfeb51ca54 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received event network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-846d7859-2f71-47e8-b4ae-9fa71602c264 req-5403b5ef-3833-4d0e-a3e1-56cfeb51ca54 service nova] Acquiring lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-846d7859-2f71-47e8-b4ae-9fa71602c264 req-5403b5ef-3833-4d0e-a3e1-56cfeb51ca54 service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-846d7859-2f71-47e8-b4ae-9fa71602c264 req-5403b5ef-3833-4d0e-a3e1-56cfeb51ca54 service nova] Lock "eb712362-b6b8-4a19-8f5b-8c374d6c4d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-846d7859-2f71-47e8-b4ae-9fa71602c264 req-5403b5ef-3833-4d0e-a3e1-56cfeb51ca54 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] No waiting events found dispatching network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:27:51 user nova-compute[75018]: WARNING nova.compute.manager [req-846d7859-2f71-47e8-b4ae-9fa71602c264 req-5403b5ef-3833-4d0e-a3e1-56cfeb51ca54 service nova] [instance: eb712362-b6b8-4a19-8f5b-8c374d6c4d87] Received unexpected event network-vif-plugged-d7fccd97-1db7-4dac-b2e9-6d5b4004aa70 for instance with vm_state deleted and task_state None.
Nov 07 15:27:51 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:51 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:27:51 user nova-compute[75018]: INFO nova.compute.claims [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Claim successful on node user
Nov 07 15:27:52 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:27:52 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:27:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG nova.policy [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '869a94fcb52246d583be8bac4a722a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374a202b7d114f009ac374762e08c364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:27:52 user nova-compute[75018]: INFO nova.compute.claims [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Claim successful on node user
Nov 07 15:27:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:27:52 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Creating image(s)
Nov 07 15:27:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "/opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "/opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "/opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.200s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk 1073741824" returned: 0 in 0.059s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Successfully created port: f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.205s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Cannot resize image /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Ensure instance console log exists: /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:27:53 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:27:53 user nova-compute[75018]: DEBUG nova.policy [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '869a94fcb52246d583be8bac4a722a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374a202b7d114f009ac374762e08c364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:27:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.compute.manager [req-ec220406-5f6c-474e-baee-d4a4cc96a75f req-1e00e725-1a9b-4af8-a11f-12a0a71a3478 service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Received event network-changed-88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.compute.manager [req-ec220406-5f6c-474e-baee-d4a4cc96a75f req-1e00e725-1a9b-4af8-a11f-12a0a71a3478 service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Refreshing instance network info cache due to event network-changed-88ce52b1-c8b7-4958-ad77-4424811b13b6. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ec220406-5f6c-474e-baee-d4a4cc96a75f req-1e00e725-1a9b-4af8-a11f-12a0a71a3478 service nova] Acquiring lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ec220406-5f6c-474e-baee-d4a4cc96a75f req-1e00e725-1a9b-4af8-a11f-12a0a71a3478 service nova] Acquired lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.network.neutron [req-ec220406-5f6c-474e-baee-d4a4cc96a75f req-1e00e725-1a9b-4af8-a11f-12a0a71a3478 service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Refreshing network info cache for port 88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:27:54 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Creating image(s)
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "/opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "/opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.194s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.185s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk 1073741824" returned: 0 in 0.069s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Successfully updated port: f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.compute.manager [req-cac78250-0a54-4f16-afb5-95fd7d3966cc req-a88f91dd-0916-41d9-9a31-7297095e2fad service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-changed-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.compute.manager [req-cac78250-0a54-4f16-afb5-95fd7d3966cc req-a88f91dd-0916-41d9-9a31-7297095e2fad service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Refreshing instance network info cache due to event network-changed-f57442b9-562b-4914-80b9-7bc2bf8c8684. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cac78250-0a54-4f16-afb5-95fd7d3966cc req-a88f91dd-0916-41d9-9a31-7297095e2fad service nova] Acquiring lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cac78250-0a54-4f16-afb5-95fd7d3966cc req-a88f91dd-0916-41d9-9a31-7297095e2fad service nova] Acquired lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.network.neutron [req-cac78250-0a54-4f16-afb5-95fd7d3966cc req-a88f91dd-0916-41d9-9a31-7297095e2fad service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Refreshing network info cache for port f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.network.neutron [req-ec220406-5f6c-474e-baee-d4a4cc96a75f req-1e00e725-1a9b-4af8-a11f-12a0a71a3478 service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updated VIF entry in instance network info cache for port 88ce52b1-c8b7-4958-ad77-4424811b13b6. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.network.neutron [req-ec220406-5f6c-474e-baee-d4a4cc96a75f req-1e00e725-1a9b-4af8-a11f-12a0a71a3478 service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updating instance_info_cache with network_info: [{"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ec220406-5f6c-474e-baee-d4a4cc96a75f req-1e00e725-1a9b-4af8-a11f-12a0a71a3478 service nova] Releasing lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Successfully created port: 2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.network.neutron [req-cac78250-0a54-4f16-afb5-95fd7d3966cc req-a88f91dd-0916-41d9-9a31-7297095e2fad service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.208s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Cannot resize image /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Ensure instance console log exists: /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.neutron [req-cac78250-0a54-4f16-afb5-95fd7d3966cc req-a88f91dd-0916-41d9-9a31-7297095e2fad service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cac78250-0a54-4f16-afb5-95fd7d3966cc req-a88f91dd-0916-41d9-9a31-7297095e2fad service nova] Releasing lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquired lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Successfully updated port: 2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquired lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-18371c3e-75b2-4282-a016-820788666fae req-3d244b10-000e-421e-8d88-d4fd06354b4f service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received event network-changed-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-18371c3e-75b2-4282-a016-820788666fae req-3d244b10-000e-421e-8d88-d4fd06354b4f service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Refreshing instance network info cache due to event network-changed-2ac8ec41-3720-4115-95a3-eef616ddb29e. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-18371c3e-75b2-4282-a016-820788666fae req-3d244b10-000e-421e-8d88-d4fd06354b4f service nova] Acquiring lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Updating instance_info_cache with network_info: [{"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Releasing lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Instance network_info: |[{"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Start _get_guest_xml network_info=[{"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:27:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:27:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1631876833',display_name='tempest-ServerRescueNegativeTestJSON-server-1631876833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1631876833',id=17,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374a202b7d114f009ac374762e08c364',ramdisk_id='',reservation_id='r-mh5926va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1476352427',owner_user_name='tempest-ServerRescueNegativeTestJSON-1476352427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:27:53Z,user_data=None,user_id='869a94fcb52246d583be8bac4a722a3c',uuid=626a4817-31f4-48c8-9ab6-07d539dd0a14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converting VIF {"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=f57442b9-562b-4914-80b9-7bc2bf8c8684,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57442b9-56') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'pci_devices' on Instance uuid 626a4817-31f4-48c8-9ab6-07d539dd0a14 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:27:55 user nova-compute[75018]:   <uuid>626a4817-31f4-48c8-9ab6-07d539dd0a14</uuid>
Nov 07 15:27:55 user nova-compute[75018]:   <name>instance-00000011</name>
Nov 07 15:27:55 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:27:55 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:27:55 user nova-compute[75018]:   <metadata>
Nov 07 15:27:55 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:27:55 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:27:55 user nova-compute[75018]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1631876833</nova:name>
Nov 07 15:27:55 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:27:55</nova:creationTime>
Nov 07 15:27:55 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:27:55 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:27:55 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:27:55 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:27:55 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:27:55 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:27:55 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:27:55 user nova-compute[75018]:       <nova:owner>
Nov 07 15:27:55 user nova-compute[75018]:         <nova:user uuid="869a94fcb52246d583be8bac4a722a3c">tempest-ServerRescueNegativeTestJSON-1476352427-project-member</nova:user>
Nov 07 15:27:55 user nova-compute[75018]:         <nova:project uuid="374a202b7d114f009ac374762e08c364">tempest-ServerRescueNegativeTestJSON-1476352427</nova:project>
Nov 07 15:27:55 user nova-compute[75018]:       </nova:owner>
Nov 07 15:27:55 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:27:55 user nova-compute[75018]:       <nova:ports>
Nov 07 15:27:55 user nova-compute[75018]:         <nova:port uuid="f57442b9-562b-4914-80b9-7bc2bf8c8684">
Nov 07 15:27:55 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 15:27:55 user nova-compute[75018]:         </nova:port>
Nov 07 15:27:55 user nova-compute[75018]:       </nova:ports>
Nov 07 15:27:55 user nova-compute[75018]:     </nova:instance>
Nov 07 15:27:55 user nova-compute[75018]:   </metadata>
Nov 07 15:27:55 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:27:55 user nova-compute[75018]:     <system>
Nov 07 15:27:55 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:27:55 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:27:55 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:27:55 user nova-compute[75018]:       <entry name="serial">626a4817-31f4-48c8-9ab6-07d539dd0a14</entry>
Nov 07 15:27:55 user nova-compute[75018]:       <entry name="uuid">626a4817-31f4-48c8-9ab6-07d539dd0a14</entry>
Nov 07 15:27:55 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:27:55 user nova-compute[75018]:     </system>
Nov 07 15:27:55 user nova-compute[75018]:   </sysinfo>
Nov 07 15:27:55 user nova-compute[75018]:   <os>
Nov 07 15:27:55 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:27:55 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:27:55 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:27:55 user nova-compute[75018]:   </os>
Nov 07 15:27:55 user nova-compute[75018]:   <features>
Nov 07 15:27:55 user nova-compute[75018]:     <acpi/>
Nov 07 15:27:55 user nova-compute[75018]:     <apic/>
Nov 07 15:27:55 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:27:55 user nova-compute[75018]:   </features>
Nov 07 15:27:55 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:27:55 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:27:55 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:27:55 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:27:55 user nova-compute[75018]:   </clock>
Nov 07 15:27:55 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:27:55 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:27:55 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:27:55 user nova-compute[75018]:   </cpu>
Nov 07 15:27:55 user nova-compute[75018]:   <devices>
Nov 07 15:27:55 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:27:55 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:27:55 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk"/>
Nov 07 15:27:55 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:27:55 user nova-compute[75018]:     </disk>
Nov 07 15:27:55 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:27:55 user nova-compute[75018]:       <mac address="fa:16:3e:30:3d:00"/>
Nov 07 15:27:55 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:27:55 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:27:55 user nova-compute[75018]:       <target dev="tapf57442b9-56"/>
Nov 07 15:27:55 user nova-compute[75018]:     </interface>
Nov 07 15:27:55 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:27:55 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/console.log" append="off"/>
Nov 07 15:27:55 user nova-compute[75018]:     </serial>
Nov 07 15:27:55 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:27:55 user nova-compute[75018]:     <video>
Nov 07 15:27:55 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:27:55 user nova-compute[75018]:     </video>
Nov 07 15:27:55 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:27:55 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:27:55 user nova-compute[75018]:     </rng>
Nov 07 15:27:55 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:27:55 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:27:55 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:27:55 user nova-compute[75018]:     </memballoon>
Nov 07 15:27:55 user nova-compute[75018]:   </devices>
Nov 07 15:27:55 user nova-compute[75018]: </domain>
Nov 07 15:27:55 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1631876833',display_name='tempest-ServerRescueNegativeTestJSON-server-1631876833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1631876833',id=17,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374a202b7d114f009ac374762e08c364',ramdisk_id='',reservation_id='r-mh5926va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1476352427',owner_user_name='tempest-ServerRescueNegativeTestJSON-1476352427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:27:53Z,user_data=None,user_id='869a94fcb52246d583be8bac4a722a3c',uuid=626a4817-31f4-48c8-9ab6-07d539dd0a14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converting VIF {"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=f57442b9-562b-4914-80b9-7bc2bf8c8684,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57442b9-56') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG os_vif [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=f57442b9-562b-4914-80b9-7bc2bf8c8684,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57442b9-56') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e74a4e88-5833-5495-8c08-71225da5ca15', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf57442b9-56, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf57442b9-56, col_values=(('qos', UUID('3f6376f9-a5de-4f20-83b3-fd5a58af3db7')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf57442b9-56, col_values=(('external_ids', {'iface-id': 'f57442b9-562b-4914-80b9-7bc2bf8c8684', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:3d:00', 'vm-uuid': '626a4817-31f4-48c8-9ab6-07d539dd0a14'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:55 user nova-compute[75018]: INFO os_vif [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=f57442b9-562b-4914-80b9-7bc2bf8c8684,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57442b9-56')
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No VIF found with MAC fa:16:3e:30:3d:00, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Updating instance_info_cache with network_info: [{"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Releasing lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Instance network_info: |[{"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-18371c3e-75b2-4282-a016-820788666fae req-3d244b10-000e-421e-8d88-d4fd06354b4f service nova] Acquired lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.neutron [req-18371c3e-75b2-4282-a016-820788666fae req-3d244b10-000e-421e-8d88-d4fd06354b4f service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Refreshing network info cache for port 2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Start _get_guest_xml network_info=[{"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:27:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:27:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-75372014',display_name='tempest-ServerRescueNegativeTestJSON-server-75372014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-75372014',id=18,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374a202b7d114f009ac374762e08c364',ramdisk_id='',reservation_id='r-1uwnu000',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1476352427',owner_user_name='tempest-ServerRescueNegativeTestJSON-1476352427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:27:54Z,user_data=None,user_id='869a94fcb52246d583be8bac4a722a3c',uuid=1e6465d9-6a61-4d6b-b876-ffdd9878fc28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converting VIF {"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:97:7a,bridge_name='br-int',has_traffic_filtering=True,id=2ac8ec41-3720-4115-95a3-eef616ddb29e,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac8ec41-37') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:27:55 user nova-compute[75018]:   <uuid>1e6465d9-6a61-4d6b-b876-ffdd9878fc28</uuid>
Nov 07 15:27:55 user nova-compute[75018]:   <name>instance-00000012</name>
Nov 07 15:27:55 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:27:55 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:27:55 user nova-compute[75018]:   <metadata>
Nov 07 15:27:55 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:27:55 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:27:55 user nova-compute[75018]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-75372014</nova:name>
Nov 07 15:27:55 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:27:55</nova:creationTime>
Nov 07 15:27:55 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:27:55 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:27:55 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:27:55 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:27:55 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:27:55 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:27:55 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:27:55 user nova-compute[75018]:       <nova:owner>
Nov 07 15:27:55 user nova-compute[75018]:         <nova:user uuid="869a94fcb52246d583be8bac4a722a3c">tempest-ServerRescueNegativeTestJSON-1476352427-project-member</nova:user>
Nov 07 15:27:55 user nova-compute[75018]:         <nova:project uuid="374a202b7d114f009ac374762e08c364">tempest-ServerRescueNegativeTestJSON-1476352427</nova:project>
Nov 07 15:27:55 user nova-compute[75018]:       </nova:owner>
Nov 07 15:27:55 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:27:55 user nova-compute[75018]:       <nova:ports>
Nov 07 15:27:55 user nova-compute[75018]:         <nova:port uuid="2ac8ec41-3720-4115-95a3-eef616ddb29e">
Nov 07 15:27:55 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 07 15:27:55 user nova-compute[75018]:         </nova:port>
Nov 07 15:27:55 user nova-compute[75018]:       </nova:ports>
Nov 07 15:27:55 user nova-compute[75018]:     </nova:instance>
Nov 07 15:27:55 user nova-compute[75018]:   </metadata>
Nov 07 15:27:55 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:27:55 user nova-compute[75018]:     <system>
Nov 07 15:27:55 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:27:55 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:27:55 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:27:55 user nova-compute[75018]:       <entry name="serial">1e6465d9-6a61-4d6b-b876-ffdd9878fc28</entry>
Nov 07 15:27:55 user nova-compute[75018]:       <entry name="uuid">1e6465d9-6a61-4d6b-b876-ffdd9878fc28</entry>
Nov 07 15:27:55 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:27:55 user nova-compute[75018]:     </system>
Nov 07 15:27:55 user nova-compute[75018]:   </sysinfo>
Nov 07 15:27:55 user nova-compute[75018]:   <os>
Nov 07 15:27:55 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:27:55 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:27:55 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:27:55 user nova-compute[75018]:   </os>
Nov 07 15:27:55 user nova-compute[75018]:   <features>
Nov 07 15:27:55 user nova-compute[75018]:     <acpi/>
Nov 07 15:27:55 user nova-compute[75018]:     <apic/>
Nov 07 15:27:55 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:27:55 user nova-compute[75018]:   </features>
Nov 07 15:27:55 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:27:55 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:27:55 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:27:55 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:27:55 user nova-compute[75018]:   </clock>
Nov 07 15:27:55 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:27:55 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:27:55 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:27:55 user nova-compute[75018]:   </cpu>
Nov 07 15:27:55 user nova-compute[75018]:   <devices>
Nov 07 15:27:55 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:27:55 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:27:55 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk"/>
Nov 07 15:27:55 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:27:55 user nova-compute[75018]:     </disk>
Nov 07 15:27:55 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:27:55 user nova-compute[75018]:       <mac address="fa:16:3e:d6:97:7a"/>
Nov 07 15:27:55 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:27:55 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:27:55 user nova-compute[75018]:       <target dev="tap2ac8ec41-37"/>
Nov 07 15:27:55 user nova-compute[75018]:     </interface>
Nov 07 15:27:55 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:27:55 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/console.log" append="off"/>
Nov 07 15:27:55 user nova-compute[75018]:     </serial>
Nov 07 15:27:55 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:27:55 user nova-compute[75018]:     <video>
Nov 07 15:27:55 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:27:55 user nova-compute[75018]:     </video>
Nov 07 15:27:55 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:27:55 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:27:55 user nova-compute[75018]:     </rng>
Nov 07 15:27:55 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:27:55 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:27:55 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:27:55 user nova-compute[75018]:     </memballoon>
Nov 07 15:27:55 user nova-compute[75018]:   </devices>
Nov 07 15:27:55 user nova-compute[75018]: </domain>
Nov 07 15:27:55 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-75372014',display_name='tempest-ServerRescueNegativeTestJSON-server-75372014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-75372014',id=18,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374a202b7d114f009ac374762e08c364',ramdisk_id='',reservation_id='r-1uwnu000',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1476352427',owner_user_name='tempest-ServerRescueNegativeTestJSON-1476352427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:27:54Z,user_data=None,user_id='869a94fcb52246d583be8bac4a722a3c',uuid=1e6465d9-6a61-4d6b-b876-ffdd9878fc28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converting VIF {"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:97:7a,bridge_name='br-int',has_traffic_filtering=True,id=2ac8ec41-3720-4115-95a3-eef616ddb29e,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac8ec41-37') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG os_vif [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:97:7a,bridge_name='br-int',has_traffic_filtering=True,id=2ac8ec41-3720-4115-95a3-eef616ddb29e,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac8ec41-37') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a959d628-0b77-5f69-99df-1098da407d13', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ac8ec41-37, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ac8ec41-37, col_values=(('qos', UUID('f21e6ac3-3c78-42c6-bdf9-15971c4b0811')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ac8ec41-37, col_values=(('external_ids', {'iface-id': '2ac8ec41-3720-4115-95a3-eef616ddb29e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:97:7a', 'vm-uuid': '1e6465d9-6a61-4d6b-b876-ffdd9878fc28'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:27:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:55 user nova-compute[75018]: INFO os_vif [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:97:7a,bridge_name='br-int',has_traffic_filtering=True,id=2ac8ec41-3720-4115-95a3-eef616ddb29e,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac8ec41-37')
Nov 07 15:27:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:27:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No VIF found with MAC fa:16:3e:d6:97:7a, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:27:56 user nova-compute[75018]: DEBUG nova.network.neutron [req-18371c3e-75b2-4282-a016-820788666fae req-3d244b10-000e-421e-8d88-d4fd06354b4f service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Updated VIF entry in instance network info cache for port 2ac8ec41-3720-4115-95a3-eef616ddb29e. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:27:56 user nova-compute[75018]: DEBUG nova.network.neutron [req-18371c3e-75b2-4282-a016-820788666fae req-3d244b10-000e-421e-8d88-d4fd06354b4f service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Updating instance_info_cache with network_info: [{"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:27:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-18371c3e-75b2-4282-a016-820788666fae req-3d244b10-000e-421e-8d88-d4fd06354b4f service nova] Releasing lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-6d9ceed0-7578-479f-b94c-0f70e58036c5 req-5c44267d-85df-4c9a-9b46-8af773a17a47 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6d9ceed0-7578-479f-b94c-0f70e58036c5 req-5c44267d-85df-4c9a-9b46-8af773a17a47 service nova] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6d9ceed0-7578-479f-b94c-0f70e58036c5 req-5c44267d-85df-4c9a-9b46-8af773a17a47 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6d9ceed0-7578-479f-b94c-0f70e58036c5 req-5c44267d-85df-4c9a-9b46-8af773a17a47 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-6d9ceed0-7578-479f-b94c-0f70e58036c5 req-5c44267d-85df-4c9a-9b46-8af773a17a47 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] No waiting events found dispatching network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:27:58 user nova-compute[75018]: WARNING nova.compute.manager [req-6d9ceed0-7578-479f-b94c-0f70e58036c5 req-5c44267d-85df-4c9a-9b46-8af773a17a47 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received unexpected event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 for instance with vm_state building and task_state spawning.
Nov 07 15:27:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-1508be9f-15e8-4e3e-9317-da366cafd0b7 req-c38a39d3-3177-42b4-991b-d4ecee37a74f service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received event network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1508be9f-15e8-4e3e-9317-da366cafd0b7 req-c38a39d3-3177-42b4-991b-d4ecee37a74f service nova] Acquiring lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1508be9f-15e8-4e3e-9317-da366cafd0b7 req-c38a39d3-3177-42b4-991b-d4ecee37a74f service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1508be9f-15e8-4e3e-9317-da366cafd0b7 req-c38a39d3-3177-42b4-991b-d4ecee37a74f service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-1508be9f-15e8-4e3e-9317-da366cafd0b7 req-c38a39d3-3177-42b4-991b-d4ecee37a74f service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] No waiting events found dispatching network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:27:58 user nova-compute[75018]: WARNING nova.compute.manager [req-1508be9f-15e8-4e3e-9317-da366cafd0b7 req-c38a39d3-3177-42b4-991b-d4ecee37a74f service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received unexpected event network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e for instance with vm_state building and task_state spawning.
Nov 07 15:27:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:27:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-4e5b8856-ebbd-4174-9445-dc1ddb4b97fa req-5784bf81-6927-4f84-9cea-391e1f9bf0b6 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4e5b8856-ebbd-4174-9445-dc1ddb4b97fa req-5784bf81-6927-4f84-9cea-391e1f9bf0b6 service nova] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4e5b8856-ebbd-4174-9445-dc1ddb4b97fa req-5784bf81-6927-4f84-9cea-391e1f9bf0b6 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4e5b8856-ebbd-4174-9445-dc1ddb4b97fa req-5784bf81-6927-4f84-9cea-391e1f9bf0b6 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-4e5b8856-ebbd-4174-9445-dc1ddb4b97fa req-5784bf81-6927-4f84-9cea-391e1f9bf0b6 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] No waiting events found dispatching network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:00 user nova-compute[75018]: WARNING nova.compute.manager [req-4e5b8856-ebbd-4174-9445-dc1ddb4b97fa req-5784bf81-6927-4f84-9cea-391e1f9bf0b6 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received unexpected event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 for instance with vm_state building and task_state spawning.
Nov 07 15:28:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-b548e2a6-a8af-4630-862a-706096456c8b req-edb9690d-d909-4502-a2ae-0ab35c7294c8 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received event network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b548e2a6-a8af-4630-862a-706096456c8b req-edb9690d-d909-4502-a2ae-0ab35c7294c8 service nova] Acquiring lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b548e2a6-a8af-4630-862a-706096456c8b req-edb9690d-d909-4502-a2ae-0ab35c7294c8 service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b548e2a6-a8af-4630-862a-706096456c8b req-edb9690d-d909-4502-a2ae-0ab35c7294c8 service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-b548e2a6-a8af-4630-862a-706096456c8b req-edb9690d-d909-4502-a2ae-0ab35c7294c8 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] No waiting events found dispatching network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:00 user nova-compute[75018]: WARNING nova.compute.manager [req-b548e2a6-a8af-4630-862a-706096456c8b req-edb9690d-d909-4502-a2ae-0ab35c7294c8 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received unexpected event network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e for instance with vm_state building and task_state spawning.
Nov 07 15:28:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:28:01 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Instance spawned successfully.
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:28:01 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Instance spawned successfully.
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:01 user nova-compute[75018]: INFO nova.compute.manager [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Took 8.87 seconds to spawn the instance on the hypervisor.
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:28:01 user nova-compute[75018]: INFO nova.compute.manager [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Took 7.60 seconds to spawn the instance on the hypervisor.
Nov 07 15:28:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:28:01 user nova-compute[75018]: INFO nova.compute.manager [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Took 9.79 seconds to build instance.
Nov 07 15:28:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9d74da1f-ccc2-4d08-bd8a-9bdbec033056 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.898s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:01 user nova-compute[75018]: INFO nova.compute.manager [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Took 9.07 seconds to build instance.
Nov 07 15:28:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e95688c9-243e-4133-a6f6-5f6f63a65228 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.198s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Starting finish_revert_migration {{(pid=75018) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Start _get_guest_xml network_info=[{"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUpZxbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8257c590-204a-4fde-8487-79b8c0c87ea7', 'attached_at': '2023-11-07T15:28:04.000000', 'detached_at': '', 'volume_id': 'f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 'serial': 'f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '50b8b695-2c1e-4a62-b52a-f8ff0e555ed0', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:28:04 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:28:04 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.objects.instance [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8257c590-204a-4fde-8487-79b8c0c87ea7 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUpZxbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:28:04 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:28:04 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:28:04 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[caba897c-d546-428a-91c2-c67d3817a13d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:28:04 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ac2ec8-0ebb-44d0-9f90-e4289706cd18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf] added
Nov 07 15:28:04 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[af868538-1d4b-4202-8cd4-0d3e3bc44c3a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0669a7f4-81c5-44c5-a015-4f23dccc6d2d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXUpZxbi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXUpZxbi" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb143b74-3d17-4281-9369-b89435cde5ff]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lXUpZxbi'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd995e9-9ba8-4e82-ac1a-770da1749cc0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d23ad40-dd62-4381-b329-a4c8fe244afe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 15:28:04 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 15:28:04 user nova-compute[75018]:  {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:28:04 user nova-compute[75018]: WARNING os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 15:28:04 user nova-compute[75018]: 
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[15859045-39ef-4e66-9c60-4665c9c5140e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260]
Nov 07 15:28:04 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260] successful.
Nov 07 15:28:04 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dec7345-d6e4-4c13-bb03-bd76f0349f5a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[799b819a-f60f-49e1-9f32-efadde33e291]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:28:04 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:28:04 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4456a2-2131-4bf1-a9f0-74c92ae4c6b9]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:28:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUpZxbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23736633539383037', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736633539383037', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077045494',display_name='tempest-ServerActionsTestOtherB-server-2077045494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077045494',id=1,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyBOTPm1HGMtOU1eTQJ9qDH8GeBUu2t+LNMgZBFFRP6tXXqDAukKUUiPODmfxQ+bXcX5mB9tkmMwlkDaHeyRpZSXxAXFTca2PcoYOgGrbYpszpri/wTQI3HjvvfuDY7fQ==',key_name='tempest-keypair-1660361084',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:25:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='585cee0db41e41dda7f10ecfc90f1daf',ramdisk_id='',reservation_id='r-rh7e0y4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1343289164',owner_user_name='tempest-ServerActionsTestOtherB-1343289164-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:27:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b867fc1e0742c3a3c5b76ed6fb756e',uuid=8257c590-204a-4fde-8487-79b8c0c87ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converting VIF {"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:28:05 user nova-compute[75018]:   <uuid>8257c590-204a-4fde-8487-79b8c0c87ea7</uuid>
Nov 07 15:28:05 user nova-compute[75018]:   <name>instance-00000001</name>
Nov 07 15:28:05 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:28:05 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:28:05 user nova-compute[75018]:   <metadata>
Nov 07 15:28:05 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:28:05 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:28:05 user nova-compute[75018]:       <nova:name>tempest-ServerActionsTestOtherB-server-2077045494</nova:name>
Nov 07 15:28:05 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:28:04</nova:creationTime>
Nov 07 15:28:05 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:28:05 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:28:05 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:28:05 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:28:05 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:28:05 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:28:05 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:28:05 user nova-compute[75018]:       <nova:owner>
Nov 07 15:28:05 user nova-compute[75018]:         <nova:user uuid="c6b867fc1e0742c3a3c5b76ed6fb756e">tempest-ServerActionsTestOtherB-1343289164-project-member</nova:user>
Nov 07 15:28:05 user nova-compute[75018]:         <nova:project uuid="585cee0db41e41dda7f10ecfc90f1daf">tempest-ServerActionsTestOtherB-1343289164</nova:project>
Nov 07 15:28:05 user nova-compute[75018]:       </nova:owner>
Nov 07 15:28:05 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:28:05 user nova-compute[75018]:       <nova:ports>
Nov 07 15:28:05 user nova-compute[75018]:         <nova:port uuid="05429ce8-06b2-4693-bf2c-5d03a4343e00">
Nov 07 15:28:05 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 07 15:28:05 user nova-compute[75018]:         </nova:port>
Nov 07 15:28:05 user nova-compute[75018]:       </nova:ports>
Nov 07 15:28:05 user nova-compute[75018]:     </nova:instance>
Nov 07 15:28:05 user nova-compute[75018]:   </metadata>
Nov 07 15:28:05 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:28:05 user nova-compute[75018]:     <system>
Nov 07 15:28:05 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:28:05 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:28:05 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:28:05 user nova-compute[75018]:       <entry name="serial">8257c590-204a-4fde-8487-79b8c0c87ea7</entry>
Nov 07 15:28:05 user nova-compute[75018]:       <entry name="uuid">8257c590-204a-4fde-8487-79b8c0c87ea7</entry>
Nov 07 15:28:05 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:28:05 user nova-compute[75018]:     </system>
Nov 07 15:28:05 user nova-compute[75018]:   </sysinfo>
Nov 07 15:28:05 user nova-compute[75018]:   <os>
Nov 07 15:28:05 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:28:05 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:28:05 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:28:05 user nova-compute[75018]:   </os>
Nov 07 15:28:05 user nova-compute[75018]:   <features>
Nov 07 15:28:05 user nova-compute[75018]:     <acpi/>
Nov 07 15:28:05 user nova-compute[75018]:     <apic/>
Nov 07 15:28:05 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:28:05 user nova-compute[75018]:   </features>
Nov 07 15:28:05 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:28:05 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:28:05 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:28:05 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:28:05 user nova-compute[75018]:   </clock>
Nov 07 15:28:05 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:28:05 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:28:05 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:28:05 user nova-compute[75018]:   </cpu>
Nov 07 15:28:05 user nova-compute[75018]:   <devices>
Nov 07 15:28:05 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:28:05 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:28:05 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk"/>
Nov 07 15:28:05 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:28:05 user nova-compute[75018]:     </disk>
Nov 07 15:28:05 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:28:05 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:28:05 user nova-compute[75018]:       <source dev="/dev/sdb"/>
Nov 07 15:28:05 user nova-compute[75018]:       <target dev="vdb" bus="virtio"/>
Nov 07 15:28:05 user nova-compute[75018]:       <serial>f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf</serial>
Nov 07 15:28:05 user nova-compute[75018]:     </disk>
Nov 07 15:28:05 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:28:05 user nova-compute[75018]:       <mac address="fa:16:3e:a6:52:2c"/>
Nov 07 15:28:05 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:28:05 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:28:05 user nova-compute[75018]:       <target dev="tap05429ce8-06"/>
Nov 07 15:28:05 user nova-compute[75018]:     </interface>
Nov 07 15:28:05 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:28:05 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/console.log" append="off"/>
Nov 07 15:28:05 user nova-compute[75018]:     </serial>
Nov 07 15:28:05 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:28:05 user nova-compute[75018]:     <video>
Nov 07 15:28:05 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:28:05 user nova-compute[75018]:     </video>
Nov 07 15:28:05 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:28:05 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:28:05 user nova-compute[75018]:     </rng>
Nov 07 15:28:05 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:28:05 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:28:05 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:28:05 user nova-compute[75018]:     </memballoon>
Nov 07 15:28:05 user nova-compute[75018]:   </devices>
Nov 07 15:28:05 user nova-compute[75018]: </domain>
Nov 07 15:28:05 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077045494',display_name='tempest-ServerActionsTestOtherB-server-2077045494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077045494',id=1,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyBOTPm1HGMtOU1eTQJ9qDH8GeBUu2t+LNMgZBFFRP6tXXqDAukKUUiPODmfxQ+bXcX5mB9tkmMwlkDaHeyRpZSXxAXFTca2PcoYOgGrbYpszpri/wTQI3HjvvfuDY7fQ==',key_name='tempest-keypair-1660361084',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:25:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='585cee0db41e41dda7f10ecfc90f1daf',ramdisk_id='',reservation_id='r-rh7e0y4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1343289164',owner_user_name='tempest-ServerActionsTestOtherB-1343289164-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:27:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b867fc1e0742c3a3c5b76ed6fb756e',uuid=8257c590-204a-4fde-8487-79b8c0c87ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converting VIF {"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG os_vif [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05a28796-a71d-5119-a6e3-33094ba73afb', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05429ce8-06, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05429ce8-06, col_values=(('qos', UUID('33aed2c9-5c6b-4fb2-af93-289a81f10bdd')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05429ce8-06, col_values=(('external_ids', {'iface-id': '05429ce8-06b2-4693-bf2c-5d03a4343e00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:52:2c', 'vm-uuid': '8257c590-204a-4fde-8487-79b8c0c87ea7'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:28:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:05 user nova-compute[75018]: INFO os_vif [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06')
Nov 07 15:28:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:07 user nova-compute[75018]: DEBUG nova.compute.manager [req-ef7e3a6a-b304-418f-9bbb-c7848266431b req-451cb77a-ffe8-40bf-888e-df96be9a98ae service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ef7e3a6a-b304-418f-9bbb-c7848266431b req-451cb77a-ffe8-40bf-888e-df96be9a98ae service nova] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ef7e3a6a-b304-418f-9bbb-c7848266431b req-451cb77a-ffe8-40bf-888e-df96be9a98ae service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ef7e3a6a-b304-418f-9bbb-c7848266431b req-451cb77a-ffe8-40bf-888e-df96be9a98ae service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:07 user nova-compute[75018]: DEBUG nova.compute.manager [req-ef7e3a6a-b304-418f-9bbb-c7848266431b req-451cb77a-ffe8-40bf-888e-df96be9a98ae service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] No waiting events found dispatching network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:07 user nova-compute[75018]: WARNING nova.compute.manager [req-ef7e3a6a-b304-418f-9bbb-c7848266431b req-451cb77a-ffe8-40bf-888e-df96be9a98ae service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received unexpected event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 for instance with vm_state resized and task_state resize_reverting.
Nov 07 15:28:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-36efb167-466b-48ee-9801-a4270741bb24 req-22a2ee2b-5ba8-4739-8808-e79eea0ea514 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-36efb167-466b-48ee-9801-a4270741bb24 req-22a2ee2b-5ba8-4739-8808-e79eea0ea514 service nova] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-36efb167-466b-48ee-9801-a4270741bb24 req-22a2ee2b-5ba8-4739-8808-e79eea0ea514 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-36efb167-466b-48ee-9801-a4270741bb24 req-22a2ee2b-5ba8-4739-8808-e79eea0ea514 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-36efb167-466b-48ee-9801-a4270741bb24 req-22a2ee2b-5ba8-4739-8808-e79eea0ea514 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] No waiting events found dispatching network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:09 user nova-compute[75018]: WARNING nova.compute.manager [req-36efb167-466b-48ee-9801-a4270741bb24 req-22a2ee2b-5ba8-4739-8808-e79eea0ea514 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received unexpected event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 for instance with vm_state resized and task_state resize_reverting.
Nov 07 15:28:09 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:28:10 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Instance running successfully.
Nov 07 15:28:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] finish_revert_migration finished successfully. {{(pid=75018) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lazy-loading 'flavor' on Instance uuid 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:10 user nova-compute[75018]: INFO nova.compute.manager [None req-9ad67248-613d-49ee-a1f9-7947eddd14b4 tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating instance to original state: 'active'
Nov 07 15:28:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:10 user nova-compute[75018]: INFO nova.compute.manager [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Attaching volume c0ebb9f2-3225-4802-998e-c3b064c3356f to /dev/vdb
Nov 07 15:28:10 user nova-compute[75018]: DEBUG os_brick.utils [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c864b8cc-86c4-4f21-9f2b-86f36b4cb365]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c776c10-1547-4d8f-abf4-795354e9c55d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54b9fd8-b98e-44d4-98dc-4192d67175e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1a42c3-c738-4d1f-a8bc-cc3853656f1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:28:10 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:28:10 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c64373-cfc0-42b1-876d-f3d81e76b9f4]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG os_brick.utils [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updating existing volume attachment record: 3fba7ffc-ed83-405d-a3b3-625055e825e2 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:28:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:12 user nova-compute[75018]: INFO nova.compute.manager [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Terminating instance
Nov 07 15:28:12 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:28:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-f214a1f1-a66f-4dd0-96d7-677194f839be req-84a30e75-c405-4a52-8272-5ee3cacaee88 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Received event network-vif-unplugged-76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f214a1f1-a66f-4dd0-96d7-677194f839be req-84a30e75-c405-4a52-8272-5ee3cacaee88 service nova] Acquiring lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f214a1f1-a66f-4dd0-96d7-677194f839be req-84a30e75-c405-4a52-8272-5ee3cacaee88 service nova] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f214a1f1-a66f-4dd0-96d7-677194f839be req-84a30e75-c405-4a52-8272-5ee3cacaee88 service nova] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-f214a1f1-a66f-4dd0-96d7-677194f839be req-84a30e75-c405-4a52-8272-5ee3cacaee88 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] No waiting events found dispatching network-vif-unplugged-76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-f214a1f1-a66f-4dd0-96d7-677194f839be req-84a30e75-c405-4a52-8272-5ee3cacaee88 service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Received event network-vif-unplugged-76649643-812d-4246-873b-3209e1d13b85 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:28:13 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Instance destroyed successfully.
Nov 07 15:28:13 user nova-compute[75018]: DEBUG nova.objects.instance [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lazy-loading 'resources' on Instance uuid 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-493910870',display_name='tempest-VolumesAdminNegativeTest-server-493910870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-493910870',id=4,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD0iGN68zs8Moz1E0eytcMxS7dagiQCYtH82O9sxDfLwZucC4K3K6iX4zsI4mfiGUxXcluZ9stk+cJchLAF3gtd7znSSNlrr8XczgvFIGCmybIM0baHWoY2bFzI+47kvA==',key_name='tempest-keypair-212283346',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:20:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27fbe1a7764e40a3ba9fc1f02c183b50',ramdisk_id='',reservation_id='r-aus20dny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-617339332',owner_user_name='tempest-VolumesAdminNegativeTest-617339332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:20:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d4b199a80014b9e8b931ee04376c693',uuid=811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76649643-812d-4246-873b-3209e1d13b85", "address": "fa:16:3e:77:19:09", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76649643-81", "ovs_interfaceid": "76649643-812d-4246-873b-3209e1d13b85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Converting VIF {"id": "76649643-812d-4246-873b-3209e1d13b85", "address": "fa:16:3e:77:19:09", "network": {"id": "fc935020-27d6-4ac8-9e8e-6fa65590da1a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-902116644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27fbe1a7764e40a3ba9fc1f02c183b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76649643-81", "ovs_interfaceid": "76649643-812d-4246-873b-3209e1d13b85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:19:09,bridge_name='br-int',has_traffic_filtering=True,id=76649643-812d-4246-873b-3209e1d13b85,network=Network(fc935020-27d6-4ac8-9e8e-6fa65590da1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76649643-81') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG os_vif [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:19:09,bridge_name='br-int',has_traffic_filtering=True,id=76649643-812d-4246-873b-3209e1d13b85,network=Network(fc935020-27d6-4ac8-9e8e-6fa65590da1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76649643-81') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76649643-81, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10284e2e-7a0d-4589-b477-9e69a339574f) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:28:13 user nova-compute[75018]: INFO os_vif [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:19:09,bridge_name='br-int',has_traffic_filtering=True,id=76649643-812d-4246-873b-3209e1d13b85,network=Network(fc935020-27d6-4ac8-9e8e-6fa65590da1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76649643-81')
Nov 07 15:28:13 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Deleting instance files /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b_del
Nov 07 15:28:13 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Deletion of /opt/stack/data/nova/instances/811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b_del complete
Nov 07 15:28:14 user nova-compute[75018]: INFO nova.compute.manager [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 07 15:28:14 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:28:14 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:28:14 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:28:14 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:28:14 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Took 0.80 seconds to deallocate network for instance.
Nov 07 15:28:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:15 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:28:15 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:28:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:15 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Deleted allocations for instance 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b
Nov 07 15:28:15 user nova-compute[75018]: DEBUG nova.compute.manager [req-72e51e62-5d63-41ec-a228-fda1d3291fe6 req-ce3ab409-11f2-4e3f-b929-0087be2eefbd service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Received event network-vif-plugged-76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-72e51e62-5d63-41ec-a228-fda1d3291fe6 req-ce3ab409-11f2-4e3f-b929-0087be2eefbd service nova] Acquiring lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-72e51e62-5d63-41ec-a228-fda1d3291fe6 req-ce3ab409-11f2-4e3f-b929-0087be2eefbd service nova] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-72e51e62-5d63-41ec-a228-fda1d3291fe6 req-ce3ab409-11f2-4e3f-b929-0087be2eefbd service nova] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:15 user nova-compute[75018]: DEBUG nova.compute.manager [req-72e51e62-5d63-41ec-a228-fda1d3291fe6 req-ce3ab409-11f2-4e3f-b929-0087be2eefbd service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] No waiting events found dispatching network-vif-plugged-76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:15 user nova-compute[75018]: WARNING nova.compute.manager [req-72e51e62-5d63-41ec-a228-fda1d3291fe6 req-ce3ab409-11f2-4e3f-b929-0087be2eefbd service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Received unexpected event network-vif-plugged-76649643-812d-4246-873b-3209e1d13b85 for instance with vm_state deleted and task_state None.
Nov 07 15:28:15 user nova-compute[75018]: DEBUG nova.compute.manager [req-72e51e62-5d63-41ec-a228-fda1d3291fe6 req-ce3ab409-11f2-4e3f-b929-0087be2eefbd service nova] [instance: 811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b] Received event network-vif-deleted-76649643-812d-4246-873b-3209e1d13b85 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4a3e464a-d741-4c03-8682-99cd76043f7e tempest-VolumesAdminNegativeTest-617339332 tempest-VolumesAdminNegativeTest-617339332-project-member] Lock "811f2d56-4ef8-4c49-9a43-e1ba0b0b9b1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.786s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:17 user nova-compute[75018]: INFO nova.compute.manager [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Terminating instance
Nov 07 15:28:17 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:28:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-946ab31f-5f09-41f7-b42c-095846216475 req-c2504c5c-4368-46c9-ad85-1b37062f45c8 service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Received event network-vif-unplugged-cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-946ab31f-5f09-41f7-b42c-095846216475 req-c2504c5c-4368-46c9-ad85-1b37062f45c8 service nova] Acquiring lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-946ab31f-5f09-41f7-b42c-095846216475 req-c2504c5c-4368-46c9-ad85-1b37062f45c8 service nova] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-946ab31f-5f09-41f7-b42c-095846216475 req-c2504c5c-4368-46c9-ad85-1b37062f45c8 service nova] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-946ab31f-5f09-41f7-b42c-095846216475 req-c2504c5c-4368-46c9-ad85-1b37062f45c8 service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] No waiting events found dispatching network-vif-unplugged-cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-946ab31f-5f09-41f7-b42c-095846216475 req-c2504c5c-4368-46c9-ad85-1b37062f45c8 service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Received event network-vif-unplugged-cd50d84f-cf19-4b67-a73a-12005d5f5078 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:28:18 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Instance destroyed successfully.
Nov 07 15:28:18 user nova-compute[75018]: DEBUG nova.objects.instance [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lazy-loading 'resources' on Instance uuid e3abd70e-baf7-4f13-832c-43696a5ea80c {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1751161907',display_name='tempest-TestVolumeSwap-server-1751161907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1751161907',id=7,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITOH4b3sJIDcUHcfoLD5tN6lQPiucD3BzQ+uUXRzOqXJy6ipG8LChx6BbgI7qpI8rUdH115x8uVeyF9/2DZlviV8Ts9812hACqANOPlRsBqllHqeAUj3iz3Yn+5BuckiA==',key_name='tempest-keypair-1641892794',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:21:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='beb79fc8bbc746178042b24a9019665c',ramdisk_id='',reservation_id='r-w0jqsgvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-908466595',owner_user_name='tempest-TestVolumeSwap-908466595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4107576c74842e7a92d18ec13934dc7',uuid=e3abd70e-baf7-4f13-832c-43696a5ea80c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "address": "fa:16:3e:0f:01:77", "network": {"id": "e5c35126-c724-438d-ac83-88c7304a8c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-84841748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beb79fc8bbc746178042b24a9019665c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd50d84f-cf", "ovs_interfaceid": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Converting VIF {"id": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "address": "fa:16:3e:0f:01:77", "network": {"id": "e5c35126-c724-438d-ac83-88c7304a8c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-84841748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beb79fc8bbc746178042b24a9019665c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd50d84f-cf", "ovs_interfaceid": "cd50d84f-cf19-4b67-a73a-12005d5f5078", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:01:77,bridge_name='br-int',has_traffic_filtering=True,id=cd50d84f-cf19-4b67-a73a-12005d5f5078,network=Network(e5c35126-c724-438d-ac83-88c7304a8c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd50d84f-cf') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG os_vif [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:01:77,bridge_name='br-int',has_traffic_filtering=True,id=cd50d84f-cf19-4b67-a73a-12005d5f5078,network=Network(e5c35126-c724-438d-ac83-88c7304a8c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd50d84f-cf') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd50d84f-cf, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51b3e155-f3e5-4262-9ec9-303a56a0f2cb) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:28:18 user nova-compute[75018]: INFO os_vif [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:01:77,bridge_name='br-int',has_traffic_filtering=True,id=cd50d84f-cf19-4b67-a73a-12005d5f5078,network=Network(e5c35126-c724-438d-ac83-88c7304a8c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd50d84f-cf')
Nov 07 15:28:18 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Deleting instance files /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c_del
Nov 07 15:28:18 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Deletion of /opt/stack/data/nova/instances/e3abd70e-baf7-4f13-832c-43696a5ea80c_del complete
Nov 07 15:28:18 user nova-compute[75018]: INFO nova.compute.manager [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 07 15:28:18 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:28:18 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:28:19 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:28:19 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Took 1.14 seconds to deallocate network for instance.
Nov 07 15:28:19 user nova-compute[75018]: DEBUG nova.compute.manager [req-ba586139-7390-4f19-a7a0-fc95ea096677 req-cb7d5205-94fe-4f5e-9b89-0a754514724a service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Received event network-vif-deleted-cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:19 user nova-compute[75018]: INFO nova.compute.manager [req-ba586139-7390-4f19-a7a0-fc95ea096677 req-cb7d5205-94fe-4f5e-9b89-0a754514724a service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Neutron deleted interface cd50d84f-cf19-4b67-a73a-12005d5f5078; detaching it from the instance and deleting it from the info cache
Nov 07 15:28:19 user nova-compute[75018]: DEBUG nova.network.neutron [req-ba586139-7390-4f19-a7a0-fc95ea096677 req-cb7d5205-94fe-4f5e-9b89-0a754514724a service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:28:19 user nova-compute[75018]: DEBUG nova.compute.manager [req-ba586139-7390-4f19-a7a0-fc95ea096677 req-cb7d5205-94fe-4f5e-9b89-0a754514724a service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Detach interface failed, port_id=cd50d84f-cf19-4b67-a73a-12005d5f5078, reason: Instance e3abd70e-baf7-4f13-832c-43696a5ea80c could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:28:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-f9bf7a6c-8415-47ec-8b66-c338c6644da4 req-f039ec4f-dcdc-47ec-af4a-bf29aa61b135 service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Received event network-vif-plugged-cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f9bf7a6c-8415-47ec-8b66-c338c6644da4 req-f039ec4f-dcdc-47ec-af4a-bf29aa61b135 service nova] Acquiring lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f9bf7a6c-8415-47ec-8b66-c338c6644da4 req-f039ec4f-dcdc-47ec-af4a-bf29aa61b135 service nova] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f9bf7a6c-8415-47ec-8b66-c338c6644da4 req-f039ec4f-dcdc-47ec-af4a-bf29aa61b135 service nova] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-f9bf7a6c-8415-47ec-8b66-c338c6644da4 req-f039ec4f-dcdc-47ec-af4a-bf29aa61b135 service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] No waiting events found dispatching network-vif-plugged-cd50d84f-cf19-4b67-a73a-12005d5f5078 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:20 user nova-compute[75018]: WARNING nova.compute.manager [req-f9bf7a6c-8415-47ec-8b66-c338c6644da4 req-f039ec4f-dcdc-47ec-af4a-bf29aa61b135 service nova] [instance: e3abd70e-baf7-4f13-832c-43696a5ea80c] Received unexpected event network-vif-plugged-cd50d84f-cf19-4b67-a73a-12005d5f5078 for instance with vm_state deleted and task_state None.
Nov 07 15:28:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:20 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:28:20 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:28:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:20 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Deleted allocations for instance e3abd70e-baf7-4f13-832c-43696a5ea80c
Nov 07 15:28:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4ce51621-01a4-4381-afff-77da51a4f808 tempest-TestVolumeSwap-908466595 tempest-TestVolumeSwap-908466595-project-member] Lock "e3abd70e-baf7-4f13-832c-43696a5ea80c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.812s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:21 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:28:23 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:28:23 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:28:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:28:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:24 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:28:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:25 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:28:25 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:28:25 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:28:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:25 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:28:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:28:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:28 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:28:28 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:28:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=25.317596435546875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 5212605c-c913-483f-874b-17af335aeb2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8257c590-204a-4fde-8487-79b8c0c87ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance af83bfa8-3661-4456-8854-f6c457e149fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:28:28 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:28:29 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:28:29 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:28:29 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:28:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:28:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:28:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:28:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-5212605c-c913-483f-874b-17af335aeb2f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:28:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-5212605c-c913-483f-874b-17af335aeb2f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:28:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:28:31 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Updating instance_info_cache with network_info: [{"id": "57d57fc6-3705-4b40-9d00-44c182114a8a", "address": "fa:16:3e:90:c3:82", "network": {"id": "10ccf061-c522-4a5b-ba65-4d89ef2fb661", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-853530484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abdb560dcda4650a47cc53ae59c9783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d57fc6-37", "ovs_interfaceid": "57d57fc6-3705-4b40-9d00-44c182114a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:28:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-5212605c-c913-483f-874b-17af335aeb2f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:28:31 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:28:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:28:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-e3d14612-5477-4d15-9745-e40b55050787 req-04d395a6-6037-47cb-b84f-30a452eae224 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-changed-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-e3d14612-5477-4d15-9745-e40b55050787 req-04d395a6-6037-47cb-b84f-30a452eae224 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Refreshing instance network info cache due to event network-changed-305ed47b-06ed-48aa-9584-70e46a35bded. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:28:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e3d14612-5477-4d15-9745-e40b55050787 req-04d395a6-6037-47cb-b84f-30a452eae224 service nova] Acquiring lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:28:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e3d14612-5477-4d15-9745-e40b55050787 req-04d395a6-6037-47cb-b84f-30a452eae224 service nova] Acquired lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:28:33 user nova-compute[75018]: DEBUG nova.network.neutron [req-e3d14612-5477-4d15-9745-e40b55050787 req-04d395a6-6037-47cb-b84f-30a452eae224 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Refreshing network info cache for port 305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:28:34 user nova-compute[75018]: DEBUG nova.network.neutron [req-e3d14612-5477-4d15-9745-e40b55050787 req-04d395a6-6037-47cb-b84f-30a452eae224 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Updated VIF entry in instance network info cache for port 305ed47b-06ed-48aa-9584-70e46a35bded. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:28:34 user nova-compute[75018]: DEBUG nova.network.neutron [req-e3d14612-5477-4d15-9745-e40b55050787 req-04d395a6-6037-47cb-b84f-30a452eae224 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Updating instance_info_cache with network_info: [{"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:28:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e3d14612-5477-4d15-9745-e40b55050787 req-04d395a6-6037-47cb-b84f-30a452eae224 service nova] Releasing lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:28:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRHUXQbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:28:36 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:28:36 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:28:36 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f528b462-8f3f-4446-bdaa-d326a918c9ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:28:36 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19d7ac3-b355-4d4f-9215-3da4eb012544]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f] added
Nov 07 15:28:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2f25ce-edf9-4516-aed2-a2eb2712bc1e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4e63d4-4c42-4fa2-8e2b-60fb145767ba]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qRHUXQbe {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qRHUXQbe" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c66e8c4-1451-4e18-8e32-258e7ab3b9b3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qRHUXQbe'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6404038-e7c5-48e9-ab67-94887c8a861e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf70021-84d3-484e-8232-b0aea137abb4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:28:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:28:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ddeee6-ee1f-4eae-85b3-12091b8f7850]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f, portal: 172.16.0.220,3260]
Nov 07 15:28:36 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f, portal: 172.16.0.220,3260] successful.
Nov 07 15:28:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e42bd4-e501-4ee9-a087-aeec703428ad]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab94e61-6fe9-4c0c-9180-a906bb7a2fbc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:28:36 user nova-compute[75018]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:28:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:28:36 user nova-compute[75018]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:28:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b59b095-8e79-4592-81a6-e57bd508a229]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:28:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRHUXQbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:28:37 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:28:37 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23838323761306336', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:28:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838323761306336', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:28:37 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lazy-loading 'flavor' on Instance uuid 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:28:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:28:37 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:28:37 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:28:37 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:28:37 user nova-compute[75018]:   <serial>c0ebb9f2-3225-4802-998e-c3b064c3356f</serial>
Nov 07 15:28:37 user nova-compute[75018]: </disk>
Nov 07 15:28:37 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:28:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:28:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:28:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] No VIF found with MAC fa:16:3e:fd:ca:d8, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:28:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a7034890-d673-4e29-a3e1-7c545617fdf3 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.017s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:39 user nova-compute[75018]: INFO nova.compute.manager [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Rescuing
Nov 07 15:28:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:28:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquired lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:28:39 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:28:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:40 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updating instance_info_cache with network_info: [{"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:28:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Releasing lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:28:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:40 user nova-compute[75018]: DEBUG nova.compute.manager [req-705212a3-6065-455b-8a0c-8fe6ff515414 req-688798a1-5e4e-42f6-a2b7-d7fc5a069697 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-vif-unplugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-705212a3-6065-455b-8a0c-8fe6ff515414 req-688798a1-5e4e-42f6-a2b7-d7fc5a069697 service nova] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-705212a3-6065-455b-8a0c-8fe6ff515414 req-688798a1-5e4e-42f6-a2b7-d7fc5a069697 service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-705212a3-6065-455b-8a0c-8fe6ff515414 req-688798a1-5e4e-42f6-a2b7-d7fc5a069697 service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:40 user nova-compute[75018]: DEBUG nova.compute.manager [req-705212a3-6065-455b-8a0c-8fe6ff515414 req-688798a1-5e4e-42f6-a2b7-d7fc5a069697 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] No waiting events found dispatching network-vif-unplugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:40 user nova-compute[75018]: WARNING nova.compute.manager [req-705212a3-6065-455b-8a0c-8fe6ff515414 req-688798a1-5e4e-42f6-a2b7-d7fc5a069697 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received unexpected event network-vif-unplugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 for instance with vm_state active and task_state rescuing.
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG nova.objects.instance [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'flavor' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:41 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Instance destroyed successfully.
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:41 user nova-compute[75018]: INFO nova.compute.manager [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Attaching volume ac5ae7db-b2b5-451b-aced-4d4b4695ad11 to /dev/vdb
Nov 07 15:28:41 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Attempting a stable device rescue
Nov 07 15:28:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75018) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Instance directory exists: not creating {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 15:28:41 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Creating image(s)
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "/opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "/opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "/opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG nova.objects.instance [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "545d2d77eef7da8f1a787b7eec60c99b6a83ed98" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "545d2d77eef7da8f1a787b7eec60c99b6a83ed98" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG os_brick.utils [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf001702-8908-488f-a9f3-f6773bc885b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd4e22c-656e-4c1e-a25f-95305823b655]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[67de5446-7c83-4b74-bd6d-1efc5d4e2aba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b28faf-b1cb-46a6-8c0a-81702b04e7d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:28:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98.part --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:28:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:28:42 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:28:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37625f1-eb97-47af-9788-2b782a5d1a12]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:28:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:28:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:28:42 user nova-compute[75018]: DEBUG os_brick.utils [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] <== get_connector_properties: return (1224ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:28:42 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Updating existing volume attachment record: e578c8b0-0d85-4559-b02a-ae4eb50bab12 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:28:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98.part --force-share --output=json" returned: 0 in 0.206s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:42 user nova-compute[75018]: DEBUG nova.virt.images [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] 505f8fd5-9f8d-45a0-89e1-e0fc00d069b6 was qcow2, converting to raw {{(pid=75018) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 15:28:42 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:28:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98.part /opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98.converted {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-c2c1f521-4455-4b12-bd74-ec1194050d7e req-5e310af4-6142-4324-9073-a62d34095215 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c2c1f521-4455-4b12-bd74-ec1194050d7e req-5e310af4-6142-4324-9073-a62d34095215 service nova] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c2c1f521-4455-4b12-bd74-ec1194050d7e req-5e310af4-6142-4324-9073-a62d34095215 service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c2c1f521-4455-4b12-bd74-ec1194050d7e req-5e310af4-6142-4324-9073-a62d34095215 service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-c2c1f521-4455-4b12-bd74-ec1194050d7e req-5e310af4-6142-4324-9073-a62d34095215 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] No waiting events found dispatching network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:43 user nova-compute[75018]: WARNING nova.compute.manager [req-c2c1f521-4455-4b12-bd74-ec1194050d7e req-5e310af4-6142-4324-9073-a62d34095215 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received unexpected event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 for instance with vm_state active and task_state rescuing.
Nov 07 15:28:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98.part /opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98.converted" returned: 0 in 0.696s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98.converted --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "545d2d77eef7da8f1a787b7eec60c99b6a83ed98" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.343s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "545d2d77eef7da8f1a787b7eec60c99b6a83ed98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "545d2d77eef7da8f1a787b7eec60c99b6a83ed98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98 --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98,backing_fmt=raw /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.rescue {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98,backing_fmt=raw /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.rescue" returned: 0 in 0.051s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "545d2d77eef7da8f1a787b7eec60c99b6a83ed98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lazy-loading 'migration_context' on Instance uuid 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.objects.base [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Object Instance<4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Start _get_guest_xml network_info=[{"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "vif_mac": "fa:16:3e:fd:ca:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '505f8fd5-9f8d-45a0-89e1-e0fc00d069b6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRHUXQbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0ebb9f2-3225-4802-998e-c3b064c3356f', 'serial': 'c0ebb9f2-3225-4802-998e-c3b064c3356f'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '3fba7ffc-ed83-405d-a3b3-625055e825e2', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lazy-loading 'resources' on Instance uuid 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.objects.base [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Object Instance<4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lazy-loading 'numa_topology' on Instance uuid 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.objects.base [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Object Instance<4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:28:44 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:28:44 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.objects.base [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Object Instance<4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRHUXQbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:28:44 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:28:44 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:28:44 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba318b53-0283-427c-b9c0-71f6fd4477c1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = qRHUXQbe\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 07 15:28:44 user nova-compute[75018]: node.name = iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f
Nov 07 15:28:44 user nova-compute[75018]: node.tpgt = -1
Nov 07 15:28:44 user nova-compute[75018]: node.startup = automatic
Nov 07 15:28:44 user nova-compute[75018]: node.leading_login = No
Nov 07 15:28:44 user nova-compute[75018]: iface.iscsi_ifacename = default
Nov 07 15:28:44 user nova-compute[75018]: iface.net_ifacename = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.ipaddress = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.prefix_len = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.hwaddress = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.transport_name = tcp
Nov 07 15:28:44 user nova-compute[75018]: iface.initiatorname = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.state = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.vlan_id = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.vlan_priority = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.vlan_state = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.iface_num = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.mtu = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.port = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.bootproto = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.subnet_mask = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.gateway = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.dhcp_alt_client_id_state = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.dhcp_alt_client_id = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.dhcp_dns = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.dhcp_learn_iqn = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.dhcp_req_vendor_id_state = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.dhcp_vendor_id_state = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.dhcp_vendor_id = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.dhcp_slp_da = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.fragmentation = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.gratuitous_arp = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.incoming_forwarding = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.tos_state = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.tos = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.ttl = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.delayed_ack = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.tcp_nagle = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.tcp_wsf_state = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.tcp_wsf = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.tcp_timer_scale = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.tcp_timestamp = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.redirect = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.def_task_mgmt_timeout = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.header_digest = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.data_digest = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.immediate_data = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.initial_r2t = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.data_seq_inorder = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.data_pdu_inorder = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.erl = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.max_receive_data_len = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.first_burst_len = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.max_outstanding_r2t = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.max_burst_len = 0
Nov 07 15:28:44 user nova-compute[75018]: iface.chap_auth = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.bidi_chap = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.strict_login_compliance = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.discovery_auth = <empty>
Nov 07 15:28:44 user nova-compute[75018]: iface.discovery_logout = <empty>
Nov 07 15:28:44 user nova-compute[75018]: node.discovery_address = <empty>
Nov 07 15:28:44 user nova-compute[75018]: node.discovery_port = 0
Nov 07 15:28:44 user nova-compute[75018]: node.discovery_type = static
Nov 07 15:28:44 user nova-compute[75018]: node.session.initial_cmdsn = 0
Nov 07 15:28:44 user nova-compute[75018]: node.session.initial_login_retry_max = 8
Nov 07 15:28:44 user nova-compute[75018]: node.session.xmit_thread_priority = -20
Nov 07 15:28:44 user nova-compute[75018]: node.session.cmds_max = 128
Nov 07 15:28:44 user nova-compute[75018]: node.session.queue_depth = 32
Nov 07 15:28:44 user nova-compute[75018]: node.session.nr_sessions = 1
Nov 07 15:28:44 user nova-compute[75018]: node.session.auth.authmethod = CHAP
Nov 07 15:28:44 user nova-compute[75018]: node.session.auth.username = qRHUXQbe
Nov 07 15:28:44 user nova-compute[75018]: node.session.auth.password = ***
Nov 07 15:28:44 user nova-compute[75018]: node.session.auth.username_in = <empty>
Nov 07 15:28:44 user nova-compute[75018]: node.session.auth.password_in = <empty>
Nov 07 15:28:44 user nova-compute[75018]: node.session.auth.chap_algs = MD5
Nov 07 15:28:44 user nova-compute[75018]: node.session.timeo.replacement_timeout = 120
Nov 07 15:28:44 user nova-compute[75018]: node.session.err_timeo.abort_timeout = 15
Nov 07 15:28:44 user nova-compute[75018]: node.session.err_timeo.lu_reset_timeout = 30
Nov 07 15:28:44 user nova-compute[75018]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 07 15:28:44 user nova-compute[75018]: node.session.err_timeo.host_reset_timeout = 60
Nov 07 15:28:44 user nova-compute[75018]: node.session.iscsi.FastAbort = Yes
Nov 07 15:28:44 user nova-compute[75018]: node.session.iscsi.InitialR2T = No
Nov 07 15:28:44 user nova-compute[75018]: node.session.iscsi.ImmediateData = Yes
Nov 07 15:28:44 user nova-compute[75018]: node.session.iscsi.FirstBurstLength = 262144
Nov 07 15:28:44 user nova-compute[75018]: node.session.iscsi.MaxBurstLength = 16776192
Nov 07 15:28:44 user nova-compute[75018]: node.session.iscsi.DefaultTime2Retain = 0
Nov 07 15:28:44 user nova-compute[75018]: node.session.iscsi.DefaultTime2Wait = 2
Nov 07 15:28:44 user nova-compute[75018]: node.session.iscsi.MaxConnections = 1
Nov 07 15:28:44 user nova-compute[75018]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 07 15:28:44 user nova-compute[75018]: node.session.iscsi.ERL = 0
Nov 07 15:28:44 user nova-compute[75018]: node.session.scan = manual
Nov 07 15:28:44 user nova-compute[75018]: node.session.reopen_max = 0
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].address = 172.16.0.220
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].port = 3260
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].startup = manual
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].tcp.window_size = 524288
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].tcp.type_of_service = 0
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].timeo.logout_timeout = 15
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].timeo.login_timeout = 15
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].timeo.auth_timeout = 45
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].timeo.noop_out_interval = 5
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].timeo.noop_out_timeout = 5
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].iscsi.HeaderDigest = None
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].iscsi.DataDigest = None
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].iscsi.IFMarker = No
Nov 07 15:28:44 user nova-compute[75018]: node.conn[0].iscsi.OFMarker = No
Nov 07 15:28:44 user nova-compute[75018]: # END RECORD
Nov 07 15:28:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53f2f01-e389-41f7-8346-2ff39f29d857]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b717ae-1a5c-4a79-89d9-9918aee6506a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qRHUXQbe {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qRHUXQbe" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86607a4-ef33-4da6-909d-37c8fc22c1d9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qRHUXQbe'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0a01d4-e137-4797-b5a8-ebaa88a60c51]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[42af49e4-4025-4627-a09b-e03de18aed89]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:28:44 user nova-compute[75018]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:28:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:28:44 user nova-compute[75018]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:28:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.164s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] HCTL ('34', '0', '0', 0) found on session 20 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0428e89a-38ca-4b7d-a8d4-f423c7ce0f84]: (4, ('0 0 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Searching for a device in session 20 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRHUXQbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '23838323761306336', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838323761306336', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1060099405',display_name='tempest-ServerStableDeviceRescueTest-server-1060099405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1060099405',id=13,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsh3m/AqvutcaB/9qpzjup0szhTy9U7TET9KerVY4YFJ3We6+i+pyTqY/LNekdndGfNoBNA07ivKONj4Ow+ANxrGLLW8+Jt5PgTGpfXG/eJIu8EEpT7vH1p59af4bkJ7w==',key_name='tempest-keypair-1769152991',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:24:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02ee8e1771f54c2487c53dc92ed64f84',ramdisk_id='',reservation_id='r-0fhpeenx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1105529090',owner_user_name='tempest-ServerStableDeviceRescueTest-1105529090-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:26:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14513d0fd65548438fa3d8566ef13d0b',uuid=4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "vif_mac": "fa:16:3e:fd:ca:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Converting VIF {"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "vif_mac": "fa:16:3e:fd:ca:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:ca:d8,bridge_name='br-int',has_traffic_filtering=True,id=97ce6c8c-ae6c-444d-a746-0c41c90dad44,network=Network(ff9ceebb-2e39-4b05-8df4-ec60615d958d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ce6c8c-ae') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.objects.base [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Object Instance<4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:28:44 user nova-compute[75018]:   <uuid>4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e</uuid>
Nov 07 15:28:44 user nova-compute[75018]:   <name>instance-0000000d</name>
Nov 07 15:28:44 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:28:44 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:28:44 user nova-compute[75018]:   <metadata>
Nov 07 15:28:44 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:28:44 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:28:44 user nova-compute[75018]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1060099405</nova:name>
Nov 07 15:28:44 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:28:44</nova:creationTime>
Nov 07 15:28:44 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:28:44 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:28:44 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:28:44 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:28:44 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:28:44 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:28:44 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:28:44 user nova-compute[75018]:       <nova:owner>
Nov 07 15:28:44 user nova-compute[75018]:         <nova:user uuid="14513d0fd65548438fa3d8566ef13d0b">tempest-ServerStableDeviceRescueTest-1105529090-project-member</nova:user>
Nov 07 15:28:44 user nova-compute[75018]:         <nova:project uuid="02ee8e1771f54c2487c53dc92ed64f84">tempest-ServerStableDeviceRescueTest-1105529090</nova:project>
Nov 07 15:28:44 user nova-compute[75018]:       </nova:owner>
Nov 07 15:28:44 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:28:44 user nova-compute[75018]:       <nova:ports>
Nov 07 15:28:44 user nova-compute[75018]:         <nova:port uuid="97ce6c8c-ae6c-444d-a746-0c41c90dad44">
Nov 07 15:28:44 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 15:28:44 user nova-compute[75018]:         </nova:port>
Nov 07 15:28:44 user nova-compute[75018]:       </nova:ports>
Nov 07 15:28:44 user nova-compute[75018]:     </nova:instance>
Nov 07 15:28:44 user nova-compute[75018]:   </metadata>
Nov 07 15:28:44 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:28:44 user nova-compute[75018]:     <system>
Nov 07 15:28:44 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:28:44 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:28:44 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:28:44 user nova-compute[75018]:       <entry name="serial">4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e</entry>
Nov 07 15:28:44 user nova-compute[75018]:       <entry name="uuid">4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e</entry>
Nov 07 15:28:44 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:28:44 user nova-compute[75018]:     </system>
Nov 07 15:28:44 user nova-compute[75018]:   </sysinfo>
Nov 07 15:28:44 user nova-compute[75018]:   <os>
Nov 07 15:28:44 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:28:44 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:28:44 user nova-compute[75018]:   </os>
Nov 07 15:28:44 user nova-compute[75018]:   <features>
Nov 07 15:28:44 user nova-compute[75018]:     <acpi/>
Nov 07 15:28:44 user nova-compute[75018]:     <apic/>
Nov 07 15:28:44 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:28:44 user nova-compute[75018]:   </features>
Nov 07 15:28:44 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:28:44 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:28:44 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:28:44 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:28:44 user nova-compute[75018]:   </clock>
Nov 07 15:28:44 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:28:44 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:28:44 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:28:44 user nova-compute[75018]:   </cpu>
Nov 07 15:28:44 user nova-compute[75018]:   <devices>
Nov 07 15:28:44 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:28:44 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:28:44 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk"/>
Nov 07 15:28:44 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:28:44 user nova-compute[75018]:     </disk>
Nov 07 15:28:44 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:28:44 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:28:44 user nova-compute[75018]:       <source dev="/dev/sdc"/>
Nov 07 15:28:44 user nova-compute[75018]:       <target dev="vdb" bus="virtio"/>
Nov 07 15:28:44 user nova-compute[75018]:       <serial>c0ebb9f2-3225-4802-998e-c3b064c3356f</serial>
Nov 07 15:28:44 user nova-compute[75018]:     </disk>
Nov 07 15:28:44 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:28:44 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:28:44 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.rescue"/>
Nov 07 15:28:44 user nova-compute[75018]:       <target dev="vdc" bus="virtio"/>
Nov 07 15:28:44 user nova-compute[75018]:       <boot order="1"/>
Nov 07 15:28:44 user nova-compute[75018]:     </disk>
Nov 07 15:28:44 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:28:44 user nova-compute[75018]:       <mac address="fa:16:3e:fd:ca:d8"/>
Nov 07 15:28:44 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:28:44 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:28:44 user nova-compute[75018]:       <target dev="tap97ce6c8c-ae"/>
Nov 07 15:28:44 user nova-compute[75018]:     </interface>
Nov 07 15:28:44 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:28:44 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/console.log" append="off"/>
Nov 07 15:28:44 user nova-compute[75018]:     </serial>
Nov 07 15:28:44 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:28:44 user nova-compute[75018]:     <video>
Nov 07 15:28:44 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:28:44 user nova-compute[75018]:     </video>
Nov 07 15:28:44 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:28:44 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:28:44 user nova-compute[75018]:     </rng>
Nov 07 15:28:44 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:28:44 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:28:44 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:28:44 user nova-compute[75018]:     </memballoon>
Nov 07 15:28:44 user nova-compute[75018]:   </devices>
Nov 07 15:28:44 user nova-compute[75018]: </domain>
Nov 07 15:28:44 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:28:44 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Instance destroyed successfully.
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] No VIF found with MAC fa:16:3e:fd:ca:d8, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:28:44 user nova-compute[75018]: INFO nova.compute.claims [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Claim successful on node user
Nov 07 15:28:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:28:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:28:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG nova.policy [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c7596f1e0e748728fa459908f89aede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d8e2c039d94beea94f85d8d5a95d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:28:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Creating image(s)
Nov 07 15:28:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "/opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "/opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.197s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.215s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk 1073741824" returned: 0 in 0.064s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Successfully created port: 1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.266s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG nova.compute.manager [req-8103701b-0455-4b1f-a920-bae4a95d3355 req-7c0a050d-2f2e-426b-9709-7e8707ae8dad service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8103701b-0455-4b1f-a920-bae4a95d3355 req-7c0a050d-2f2e-426b-9709-7e8707ae8dad service nova] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8103701b-0455-4b1f-a920-bae4a95d3355 req-7c0a050d-2f2e-426b-9709-7e8707ae8dad service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8103701b-0455-4b1f-a920-bae4a95d3355 req-7c0a050d-2f2e-426b-9709-7e8707ae8dad service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG nova.compute.manager [req-8103701b-0455-4b1f-a920-bae4a95d3355 req-7c0a050d-2f2e-426b-9709-7e8707ae8dad service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] No waiting events found dispatching network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:46 user nova-compute[75018]: WARNING nova.compute.manager [req-8103701b-0455-4b1f-a920-bae4a95d3355 req-7c0a050d-2f2e-426b-9709-7e8707ae8dad service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received unexpected event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 for instance with vm_state active and task_state rescuing.
Nov 07 15:28:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Cannot resize image /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Ensure instance console log exists: /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:47 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Successfully updated port: 1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:28:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:28:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquired lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:28:47 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:28:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-0c317a59-f853-4a4d-98d2-ab8beef7e753 req-8d773bef-71ec-4659-9d6c-5c4197300f10 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-changed-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-0c317a59-f853-4a4d-98d2-ab8beef7e753 req-8d773bef-71ec-4659-9d6c-5c4197300f10 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Refreshing instance network info cache due to event network-changed-1a222150-39b6-4eb8-8502-379bd9f9f468. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:28:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0c317a59-f853-4a4d-98d2-ab8beef7e753 req-8d773bef-71ec-4659-9d6c-5c4197300f10 service nova] Acquiring lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:28:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:47 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Updating instance_info_cache with network_info: [{"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Releasing lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Instance network_info: |[{"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0c317a59-f853-4a4d-98d2-ab8beef7e753 req-8d773bef-71ec-4659-9d6c-5c4197300f10 service nova] Acquired lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.network.neutron [req-0c317a59-f853-4a4d-98d2-ab8beef7e753 req-8d773bef-71ec-4659-9d6c-5c4197300f10 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Refreshing network info cache for port 1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Start _get_guest_xml network_info=[{"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:28:48 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:28:48 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:28:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-69325560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-69325560',id=19,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaOv2W2tLVLZXeJouTLzkDUUJ5/sVjsATl2Nzga1jOlwbQ4D+LsMnHpvBFVTtTOkra++qIzs0qRkNi3BAnUQDH52yljVA+1NpUjMXRdcnhtKUGecCiOuRrqaFwZkBSrIA==',key_name='tempest-keypair-685240993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1d8e2c039d94beea94f85d8d5a95d95',ramdisk_id='',reservation_id='r-n25mco0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-175335890',owner_user_name='tempest-AttachVolumeShelveTestJSON-175335890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:28:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c7596f1e0e748728fa459908f89aede',uuid=ca4ef7a3-718c-40c0-a2e0-bb636fc2214d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converting VIF {"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:62:d5,bridge_name='br-int',has_traffic_filtering=True,id=1a222150-39b6-4eb8-8502-379bd9f9f468,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a222150-39') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.objects.instance [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'pci_devices' on Instance uuid ca4ef7a3-718c-40c0-a2e0-bb636fc2214d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:28:48 user nova-compute[75018]:   <uuid>ca4ef7a3-718c-40c0-a2e0-bb636fc2214d</uuid>
Nov 07 15:28:48 user nova-compute[75018]:   <name>instance-00000013</name>
Nov 07 15:28:48 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:28:48 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:28:48 user nova-compute[75018]:   <metadata>
Nov 07 15:28:48 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:28:48 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:28:48 user nova-compute[75018]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-69325560</nova:name>
Nov 07 15:28:48 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:28:48</nova:creationTime>
Nov 07 15:28:48 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:28:48 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:28:48 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:28:48 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:28:48 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:28:48 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:28:48 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:28:48 user nova-compute[75018]:       <nova:owner>
Nov 07 15:28:48 user nova-compute[75018]:         <nova:user uuid="9c7596f1e0e748728fa459908f89aede">tempest-AttachVolumeShelveTestJSON-175335890-project-member</nova:user>
Nov 07 15:28:48 user nova-compute[75018]:         <nova:project uuid="e1d8e2c039d94beea94f85d8d5a95d95">tempest-AttachVolumeShelveTestJSON-175335890</nova:project>
Nov 07 15:28:48 user nova-compute[75018]:       </nova:owner>
Nov 07 15:28:48 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:28:48 user nova-compute[75018]:       <nova:ports>
Nov 07 15:28:48 user nova-compute[75018]:         <nova:port uuid="1a222150-39b6-4eb8-8502-379bd9f9f468">
Nov 07 15:28:48 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 07 15:28:48 user nova-compute[75018]:         </nova:port>
Nov 07 15:28:48 user nova-compute[75018]:       </nova:ports>
Nov 07 15:28:48 user nova-compute[75018]:     </nova:instance>
Nov 07 15:28:48 user nova-compute[75018]:   </metadata>
Nov 07 15:28:48 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:28:48 user nova-compute[75018]:     <system>
Nov 07 15:28:48 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:28:48 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:28:48 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:28:48 user nova-compute[75018]:       <entry name="serial">ca4ef7a3-718c-40c0-a2e0-bb636fc2214d</entry>
Nov 07 15:28:48 user nova-compute[75018]:       <entry name="uuid">ca4ef7a3-718c-40c0-a2e0-bb636fc2214d</entry>
Nov 07 15:28:48 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:28:48 user nova-compute[75018]:     </system>
Nov 07 15:28:48 user nova-compute[75018]:   </sysinfo>
Nov 07 15:28:48 user nova-compute[75018]:   <os>
Nov 07 15:28:48 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:28:48 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:28:48 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:28:48 user nova-compute[75018]:   </os>
Nov 07 15:28:48 user nova-compute[75018]:   <features>
Nov 07 15:28:48 user nova-compute[75018]:     <acpi/>
Nov 07 15:28:48 user nova-compute[75018]:     <apic/>
Nov 07 15:28:48 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:28:48 user nova-compute[75018]:   </features>
Nov 07 15:28:48 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:28:48 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:28:48 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:28:48 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:28:48 user nova-compute[75018]:   </clock>
Nov 07 15:28:48 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:28:48 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:28:48 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:28:48 user nova-compute[75018]:   </cpu>
Nov 07 15:28:48 user nova-compute[75018]:   <devices>
Nov 07 15:28:48 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:28:48 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:28:48 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk"/>
Nov 07 15:28:48 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:28:48 user nova-compute[75018]:     </disk>
Nov 07 15:28:48 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:28:48 user nova-compute[75018]:       <mac address="fa:16:3e:9d:62:d5"/>
Nov 07 15:28:48 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:28:48 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:28:48 user nova-compute[75018]:       <target dev="tap1a222150-39"/>
Nov 07 15:28:48 user nova-compute[75018]:     </interface>
Nov 07 15:28:48 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:28:48 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/console.log" append="off"/>
Nov 07 15:28:48 user nova-compute[75018]:     </serial>
Nov 07 15:28:48 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:28:48 user nova-compute[75018]:     <video>
Nov 07 15:28:48 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:28:48 user nova-compute[75018]:     </video>
Nov 07 15:28:48 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:28:48 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:28:48 user nova-compute[75018]:     </rng>
Nov 07 15:28:48 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:28:48 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:28:48 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:28:48 user nova-compute[75018]:     </memballoon>
Nov 07 15:28:48 user nova-compute[75018]:   </devices>
Nov 07 15:28:48 user nova-compute[75018]: </domain>
Nov 07 15:28:48 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:28:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-69325560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-69325560',id=19,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaOv2W2tLVLZXeJouTLzkDUUJ5/sVjsATl2Nzga1jOlwbQ4D+LsMnHpvBFVTtTOkra++qIzs0qRkNi3BAnUQDH52yljVA+1NpUjMXRdcnhtKUGecCiOuRrqaFwZkBSrIA==',key_name='tempest-keypair-685240993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1d8e2c039d94beea94f85d8d5a95d95',ramdisk_id='',reservation_id='r-n25mco0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-175335890',owner_user_name='tempest-AttachVolumeShelveTestJSON-175335890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:28:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c7596f1e0e748728fa459908f89aede',uuid=ca4ef7a3-718c-40c0-a2e0-bb636fc2214d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converting VIF {"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:62:d5,bridge_name='br-int',has_traffic_filtering=True,id=1a222150-39b6-4eb8-8502-379bd9f9f468,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a222150-39') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG os_vif [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:62:d5,bridge_name='br-int',has_traffic_filtering=True,id=1a222150-39b6-4eb8-8502-379bd9f9f468,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a222150-39') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f6c6eb0-7dfb-5b97-9d38-31b53b359a51', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a222150-39, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a222150-39, col_values=(('qos', UUID('71e26c5f-a94c-485c-a3a5-78b21aef57b5')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a222150-39, col_values=(('external_ids', {'iface-id': '1a222150-39b6-4eb8-8502-379bd9f9f468', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:62:d5', 'vm-uuid': 'ca4ef7a3-718c-40c0-a2e0-bb636fc2214d'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:48 user nova-compute[75018]: INFO os_vif [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:62:d5,bridge_name='br-int',has_traffic_filtering=True,id=1a222150-39b6-4eb8-8502-379bd9f9f468,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a222150-39')
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] No VIF found with MAC fa:16:3e:9d:62:d5, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-baf62e5f-ec97-4879-aa2a-978cf80ce3c1 req-86248966-caa0-4e42-996e-44e90ce199bd service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-baf62e5f-ec97-4879-aa2a-978cf80ce3c1 req-86248966-caa0-4e42-996e-44e90ce199bd service nova] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-baf62e5f-ec97-4879-aa2a-978cf80ce3c1 req-86248966-caa0-4e42-996e-44e90ce199bd service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-baf62e5f-ec97-4879-aa2a-978cf80ce3c1 req-86248966-caa0-4e42-996e-44e90ce199bd service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-baf62e5f-ec97-4879-aa2a-978cf80ce3c1 req-86248966-caa0-4e42-996e-44e90ce199bd service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] No waiting events found dispatching network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:48 user nova-compute[75018]: WARNING nova.compute.manager [req-baf62e5f-ec97-4879-aa2a-978cf80ce3c1 req-86248966-caa0-4e42-996e-44e90ce199bd service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received unexpected event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 for instance with vm_state active and task_state rescuing.
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5445f547-df40-4f75-b633-b68efafffccb tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.network.neutron [req-0c317a59-f853-4a4d-98d2-ab8beef7e753 req-8d773bef-71ec-4659-9d6c-5c4197300f10 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Updated VIF entry in instance network info cache for port 1a222150-39b6-4eb8-8502-379bd9f9f468. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG nova.network.neutron [req-0c317a59-f853-4a4d-98d2-ab8beef7e753 req-8d773bef-71ec-4659-9d6c-5c4197300f10 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Updating instance_info_cache with network_info: [{"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:28:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0c317a59-f853-4a4d-98d2-ab8beef7e753 req-8d773bef-71ec-4659-9d6c-5c4197300f10 service nova] Releasing lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:28:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "55fb155e-ec0a-4d67-8427-c2158da7003a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:51 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:28:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:51 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:28:51 user nova-compute[75018]: INFO nova.compute.claims [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Claim successful on node user
Nov 07 15:28:52 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:28:52 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:28:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.742s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:28:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:28:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:28:52 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:28:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:28:52 user nova-compute[75018]: DEBUG nova.policy [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd80017cc8cf244dcb253874281d73f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcb8653b534c4619abf6bc1d943bd534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:28:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:28:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:28:52 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Creating image(s)
Nov 07 15:28:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "/opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "/opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "/opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.224s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:28:53 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Instance spawned successfully.
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:28:53 user nova-compute[75018]: INFO nova.compute.manager [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Took 7.68 seconds to spawn the instance on the hypervisor.
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.270s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk 1073741824" returned: 0 in 0.088s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.363s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:53 user nova-compute[75018]: INFO nova.compute.manager [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Took 8.74 seconds to build instance.
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f9b0123b-8576-46b8-ba6c-0030bbd4336a tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.885s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.198s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Successfully created port: 62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-7041fb94-d439-4658-8ef3-8d1cb6000ff5 req-70b5fc96-15a0-4dd7-acf0-a4178a052657 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7041fb94-d439-4658-8ef3-8d1cb6000ff5 req-70b5fc96-15a0-4dd7-acf0-a4178a052657 service nova] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7041fb94-d439-4658-8ef3-8d1cb6000ff5 req-70b5fc96-15a0-4dd7-acf0-a4178a052657 service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7041fb94-d439-4658-8ef3-8d1cb6000ff5 req-70b5fc96-15a0-4dd7-acf0-a4178a052657 service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-7041fb94-d439-4658-8ef3-8d1cb6000ff5 req-70b5fc96-15a0-4dd7-acf0-a4178a052657 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] No waiting events found dispatching network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:53 user nova-compute[75018]: WARNING nova.compute.manager [req-7041fb94-d439-4658-8ef3-8d1cb6000ff5 req-70b5fc96-15a0-4dd7-acf0-a4178a052657 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received unexpected event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 for instance with vm_state active and task_state None.
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Cannot resize image /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Ensure instance console log exists: /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Successfully updated port: 62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "refresh_cache-55fb155e-ec0a-4d67-8427-c2158da7003a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquired lock "refresh_cache-55fb155e-ec0a-4d67-8427-c2158da7003a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Updating instance_info_cache with network_info: [{"id": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "address": "fa:16:3e:31:e2:74", "network": {"id": "4d4dfcec-fc10-48d8-88aa-a55b766a3bd3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-591672914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb8653b534c4619abf6bc1d943bd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ebf755-00", "ovs_interfaceid": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Releasing lock "refresh_cache-55fb155e-ec0a-4d67-8427-c2158da7003a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Instance network_info: |[{"id": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "address": "fa:16:3e:31:e2:74", "network": {"id": "4d4dfcec-fc10-48d8-88aa-a55b766a3bd3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-591672914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb8653b534c4619abf6bc1d943bd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ebf755-00", "ovs_interfaceid": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Start _get_guest_xml network_info=[{"id": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "address": "fa:16:3e:31:e2:74", "network": {"id": "4d4dfcec-fc10-48d8-88aa-a55b766a3bd3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-591672914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb8653b534c4619abf6bc1d943bd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ebf755-00", "ovs_interfaceid": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:28:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:28:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1598711660',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1598711660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1598711',id=20,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpvvG9zuGjDx4CbNrYf5WmVhEQPI6BfySkCbfR1pCWsGE5J/HwJA3LlJu9OZFEFawIqVG+t2Rnj2NQWuY313NpRQQC+vRzsyfNXZuLpTfoDwyV7Dc3YrgjAF5kffy0IMg==',key_name='tempest-keypair-1643263547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcb8653b534c4619abf6bc1d943bd534',ramdisk_id='',reservation_id='r-qo8we1xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-189216407',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:28:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d80017cc8cf244dcb253874281d73f13',uuid=55fb155e-ec0a-4d67-8427-c2158da7003a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "address": "fa:16:3e:31:e2:74", "network": {"id": "4d4dfcec-fc10-48d8-88aa-a55b766a3bd3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-591672914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb8653b534c4619abf6bc1d943bd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ebf755-00", "ovs_interfaceid": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Converting VIF {"id": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "address": "fa:16:3e:31:e2:74", "network": {"id": "4d4dfcec-fc10-48d8-88aa-a55b766a3bd3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-591672914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb8653b534c4619abf6bc1d943bd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ebf755-00", "ovs_interfaceid": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:e2:74,bridge_name='br-int',has_traffic_filtering=True,id=62ebf755-0030-4d56-bf5d-bbd25c14c1ef,network=Network(4d4dfcec-fc10-48d8-88aa-a55b766a3bd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62ebf755-00') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lazy-loading 'pci_devices' on Instance uuid 55fb155e-ec0a-4d67-8427-c2158da7003a {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:28:55 user nova-compute[75018]:   <uuid>55fb155e-ec0a-4d67-8427-c2158da7003a</uuid>
Nov 07 15:28:55 user nova-compute[75018]:   <name>instance-00000014</name>
Nov 07 15:28:55 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:28:55 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:28:55 user nova-compute[75018]:   <metadata>
Nov 07 15:28:55 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:28:55 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:28:55 user nova-compute[75018]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1598711660</nova:name>
Nov 07 15:28:55 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:28:55</nova:creationTime>
Nov 07 15:28:55 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:28:55 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:28:55 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:28:55 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:28:55 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:28:55 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:28:55 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:28:55 user nova-compute[75018]:       <nova:owner>
Nov 07 15:28:55 user nova-compute[75018]:         <nova:user uuid="d80017cc8cf244dcb253874281d73f13">tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member</nova:user>
Nov 07 15:28:55 user nova-compute[75018]:         <nova:project uuid="dcb8653b534c4619abf6bc1d943bd534">tempest-TestServerVolumeAttachScenarioOldVersion-189216407</nova:project>
Nov 07 15:28:55 user nova-compute[75018]:       </nova:owner>
Nov 07 15:28:55 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:28:55 user nova-compute[75018]:       <nova:ports>
Nov 07 15:28:55 user nova-compute[75018]:         <nova:port uuid="62ebf755-0030-4d56-bf5d-bbd25c14c1ef">
Nov 07 15:28:55 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 15:28:55 user nova-compute[75018]:         </nova:port>
Nov 07 15:28:55 user nova-compute[75018]:       </nova:ports>
Nov 07 15:28:55 user nova-compute[75018]:     </nova:instance>
Nov 07 15:28:55 user nova-compute[75018]:   </metadata>
Nov 07 15:28:55 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:28:55 user nova-compute[75018]:     <system>
Nov 07 15:28:55 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:28:55 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:28:55 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:28:55 user nova-compute[75018]:       <entry name="serial">55fb155e-ec0a-4d67-8427-c2158da7003a</entry>
Nov 07 15:28:55 user nova-compute[75018]:       <entry name="uuid">55fb155e-ec0a-4d67-8427-c2158da7003a</entry>
Nov 07 15:28:55 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:28:55 user nova-compute[75018]:     </system>
Nov 07 15:28:55 user nova-compute[75018]:   </sysinfo>
Nov 07 15:28:55 user nova-compute[75018]:   <os>
Nov 07 15:28:55 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:28:55 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:28:55 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:28:55 user nova-compute[75018]:   </os>
Nov 07 15:28:55 user nova-compute[75018]:   <features>
Nov 07 15:28:55 user nova-compute[75018]:     <acpi/>
Nov 07 15:28:55 user nova-compute[75018]:     <apic/>
Nov 07 15:28:55 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:28:55 user nova-compute[75018]:   </features>
Nov 07 15:28:55 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:28:55 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:28:55 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:28:55 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:28:55 user nova-compute[75018]:   </clock>
Nov 07 15:28:55 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:28:55 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:28:55 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:28:55 user nova-compute[75018]:   </cpu>
Nov 07 15:28:55 user nova-compute[75018]:   <devices>
Nov 07 15:28:55 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:28:55 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:28:55 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk"/>
Nov 07 15:28:55 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:28:55 user nova-compute[75018]:     </disk>
Nov 07 15:28:55 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:28:55 user nova-compute[75018]:       <mac address="fa:16:3e:31:e2:74"/>
Nov 07 15:28:55 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:28:55 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:28:55 user nova-compute[75018]:       <target dev="tap62ebf755-00"/>
Nov 07 15:28:55 user nova-compute[75018]:     </interface>
Nov 07 15:28:55 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:28:55 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/console.log" append="off"/>
Nov 07 15:28:55 user nova-compute[75018]:     </serial>
Nov 07 15:28:55 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:28:55 user nova-compute[75018]:     <video>
Nov 07 15:28:55 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:28:55 user nova-compute[75018]:     </video>
Nov 07 15:28:55 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:28:55 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:28:55 user nova-compute[75018]:     </rng>
Nov 07 15:28:55 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:28:55 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:28:55 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:28:55 user nova-compute[75018]:     </memballoon>
Nov 07 15:28:55 user nova-compute[75018]:   </devices>
Nov 07 15:28:55 user nova-compute[75018]: </domain>
Nov 07 15:28:55 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1598711660',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1598711660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1598711',id=20,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpvvG9zuGjDx4CbNrYf5WmVhEQPI6BfySkCbfR1pCWsGE5J/HwJA3LlJu9OZFEFawIqVG+t2Rnj2NQWuY313NpRQQC+vRzsyfNXZuLpTfoDwyV7Dc3YrgjAF5kffy0IMg==',key_name='tempest-keypair-1643263547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcb8653b534c4619abf6bc1d943bd534',ramdisk_id='',reservation_id='r-qo8we1xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-189216407',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:28:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d80017cc8cf244dcb253874281d73f13',uuid=55fb155e-ec0a-4d67-8427-c2158da7003a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "address": "fa:16:3e:31:e2:74", "network": {"id": "4d4dfcec-fc10-48d8-88aa-a55b766a3bd3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-591672914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb8653b534c4619abf6bc1d943bd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ebf755-00", "ovs_interfaceid": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Converting VIF {"id": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "address": "fa:16:3e:31:e2:74", "network": {"id": "4d4dfcec-fc10-48d8-88aa-a55b766a3bd3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-591672914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb8653b534c4619abf6bc1d943bd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ebf755-00", "ovs_interfaceid": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:e2:74,bridge_name='br-int',has_traffic_filtering=True,id=62ebf755-0030-4d56-bf5d-bbd25c14c1ef,network=Network(4d4dfcec-fc10-48d8-88aa-a55b766a3bd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62ebf755-00') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG os_vif [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:e2:74,bridge_name='br-int',has_traffic_filtering=True,id=62ebf755-0030-4d56-bf5d-bbd25c14c1ef,network=Network(4d4dfcec-fc10-48d8-88aa-a55b766a3bd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62ebf755-00') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9fd4983-2b63-5bfa-bf77-cb6689f350bf', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62ebf755-00, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62ebf755-00, col_values=(('qos', UUID('4a66a64f-2259-4aba-aa5e-1774a01f3162')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62ebf755-00, col_values=(('external_ids', {'iface-id': '62ebf755-0030-4d56-bf5d-bbd25c14c1ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:e2:74', 'vm-uuid': '55fb155e-ec0a-4d67-8427-c2158da7003a'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:55 user nova-compute[75018]: INFO os_vif [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:e2:74,bridge_name='br-int',has_traffic_filtering=True,id=62ebf755-0030-4d56-bf5d-bbd25c14c1ef,network=Network(4d4dfcec-fc10-48d8-88aa-a55b766a3bd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62ebf755-00')
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] No VIF found with MAC fa:16:3e:31:e2:74, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-5f35b974-1af2-441b-a366-0c95ba5b7513 req-20f6dc03-a212-4e20-b31d-29dec9070978 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5f35b974-1af2-441b-a366-0c95ba5b7513 req-20f6dc03-a212-4e20-b31d-29dec9070978 service nova] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5f35b974-1af2-441b-a366-0c95ba5b7513 req-20f6dc03-a212-4e20-b31d-29dec9070978 service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5f35b974-1af2-441b-a366-0c95ba5b7513 req-20f6dc03-a212-4e20-b31d-29dec9070978 service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-5f35b974-1af2-441b-a366-0c95ba5b7513 req-20f6dc03-a212-4e20-b31d-29dec9070978 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] No waiting events found dispatching network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:55 user nova-compute[75018]: WARNING nova.compute.manager [req-5f35b974-1af2-441b-a366-0c95ba5b7513 req-20f6dc03-a212-4e20-b31d-29dec9070978 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received unexpected event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 for instance with vm_state active and task_state None.
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-5f35b974-1af2-441b-a366-0c95ba5b7513 req-20f6dc03-a212-4e20-b31d-29dec9070978 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Received event network-changed-62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-5f35b974-1af2-441b-a366-0c95ba5b7513 req-20f6dc03-a212-4e20-b31d-29dec9070978 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Refreshing instance network info cache due to event network-changed-62ebf755-0030-4d56-bf5d-bbd25c14c1ef. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5f35b974-1af2-441b-a366-0c95ba5b7513 req-20f6dc03-a212-4e20-b31d-29dec9070978 service nova] Acquiring lock "refresh_cache-55fb155e-ec0a-4d67-8427-c2158da7003a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5f35b974-1af2-441b-a366-0c95ba5b7513 req-20f6dc03-a212-4e20-b31d-29dec9070978 service nova] Acquired lock "refresh_cache-55fb155e-ec0a-4d67-8427-c2158da7003a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:28:55 user nova-compute[75018]: DEBUG nova.network.neutron [req-5f35b974-1af2-441b-a366-0c95ba5b7513 req-20f6dc03-a212-4e20-b31d-29dec9070978 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Refreshing network info cache for port 62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:28:56 user nova-compute[75018]: DEBUG nova.network.neutron [req-5f35b974-1af2-441b-a366-0c95ba5b7513 req-20f6dc03-a212-4e20-b31d-29dec9070978 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Updated VIF entry in instance network info cache for port 62ebf755-0030-4d56-bf5d-bbd25c14c1ef. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:28:56 user nova-compute[75018]: DEBUG nova.network.neutron [req-5f35b974-1af2-441b-a366-0c95ba5b7513 req-20f6dc03-a212-4e20-b31d-29dec9070978 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Updating instance_info_cache with network_info: [{"id": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "address": "fa:16:3e:31:e2:74", "network": {"id": "4d4dfcec-fc10-48d8-88aa-a55b766a3bd3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-591672914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb8653b534c4619abf6bc1d943bd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ebf755-00", "ovs_interfaceid": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:28:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5f35b974-1af2-441b-a366-0c95ba5b7513 req-20f6dc03-a212-4e20-b31d-29dec9070978 service nova] Releasing lock "refresh_cache-55fb155e-ec0a-4d67-8427-c2158da7003a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:28:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-cb28adb0-76e4-428d-91d8-0a18cffdb8bc req-099b73f0-ba96-4c14-a67d-26c4dac3786d service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Received event network-vif-plugged-62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cb28adb0-76e4-428d-91d8-0a18cffdb8bc req-099b73f0-ba96-4c14-a67d-26c4dac3786d service nova] Acquiring lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cb28adb0-76e4-428d-91d8-0a18cffdb8bc req-099b73f0-ba96-4c14-a67d-26c4dac3786d service nova] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cb28adb0-76e4-428d-91d8-0a18cffdb8bc req-099b73f0-ba96-4c14-a67d-26c4dac3786d service nova] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-cb28adb0-76e4-428d-91d8-0a18cffdb8bc req-099b73f0-ba96-4c14-a67d-26c4dac3786d service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] No waiting events found dispatching network-vif-plugged-62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:57 user nova-compute[75018]: WARNING nova.compute.manager [req-cb28adb0-76e4-428d-91d8-0a18cffdb8bc req-099b73f0-ba96-4c14-a67d-26c4dac3786d service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Received unexpected event network-vif-plugged-62ebf755-0030-4d56-bf5d-bbd25c14c1ef for instance with vm_state building and task_state spawning.
Nov 07 15:28:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:28:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-454b4021-2fc5-4d05-a315-def1138a4065 req-8060a222-b8c3-4f9b-895d-92eaf7ecee45 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Received event network-vif-plugged-62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:28:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-454b4021-2fc5-4d05-a315-def1138a4065 req-8060a222-b8c3-4f9b-895d-92eaf7ecee45 service nova] Acquiring lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:28:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-454b4021-2fc5-4d05-a315-def1138a4065 req-8060a222-b8c3-4f9b-895d-92eaf7ecee45 service nova] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:28:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-454b4021-2fc5-4d05-a315-def1138a4065 req-8060a222-b8c3-4f9b-895d-92eaf7ecee45 service nova] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:28:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-454b4021-2fc5-4d05-a315-def1138a4065 req-8060a222-b8c3-4f9b-895d-92eaf7ecee45 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] No waiting events found dispatching network-vif-plugged-62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:28:59 user nova-compute[75018]: WARNING nova.compute.manager [req-454b4021-2fc5-4d05-a315-def1138a4065 req-8060a222-b8c3-4f9b-895d-92eaf7ecee45 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Received unexpected event network-vif-plugged-62ebf755-0030-4d56-bf5d-bbd25c14c1ef for instance with vm_state building and task_state spawning.
Nov 07 15:29:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:29:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:29:00 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Instance spawned successfully.
Nov 07 15:29:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:29:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:29:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:29:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:29:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:29:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:29:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:29:00 user nova-compute[75018]: INFO nova.compute.manager [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Took 7.31 seconds to spawn the instance on the hypervisor.
Nov 07 15:29:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:29:00 user nova-compute[75018]: INFO nova.compute.manager [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Took 8.53 seconds to build instance.
Nov 07 15:29:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1d17af71-642e-41fc-8f76-c88d7ec4acd6 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.656s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYhTCRdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:29:22 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:29:22 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:29:22 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f517ba0-e95e-49f9-a1fd-693889eca195]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:29:22 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33cb6d5-f728-4bab-96cb-86f4dd6b6e13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11] added
Nov 07 15:29:22 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a8bf9f-f411-4c68-9f0a-7dea1966fa12]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed82bd31-fd9f-4a17-b093-b5b23fa0a718]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYhTCRdQ {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYhTCRdQ" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ea80fc-f649-424d-ba7d-8572414f99ac]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oYhTCRdQ'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fa8985-28fe-4b1b-9f8c-398b8878d94b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedc67a6-e1be-4aad-ae64-b4f8a8ca15ee]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:29:22 user nova-compute[75018]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:29:22 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:29:22 user nova-compute[75018]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:29:22 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ec5742-960a-423d-a777-2630912aa05a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260]
Nov 07 15:29:22 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260] successful.
Nov 07 15:29:22 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6bf5b1-9fa2-4438-9235-1822b4c7e797]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68efc9b-5401-478b-8811-22be1fdb6101]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:29:22 user nova-compute[75018]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:29:22 user nova-compute[75018]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:29:22 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:29:22 user nova-compute[75018]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:29:22 user nova-compute[75018]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:29:22 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f696887-a27d-430f-adce-693416c3a406]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:29:22 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:29:23 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:29:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:29:23 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:29:23 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYhTCRdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:29:23 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:29:23 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26537343261623338', 'path': '/dev/sdd'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:29:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537343261623338', 'path': '/dev/sdd'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:29:23 user nova-compute[75018]: DEBUG nova.objects.instance [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'flavor' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:29:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:29:23 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:29:23 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:29:23 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:29:23 user nova-compute[75018]:   <serial>ac5ae7db-b2b5-451b-aced-4d4b4695ad11</serial>
Nov 07 15:29:23 user nova-compute[75018]: </disk>
Nov 07 15:29:23 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:29:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:29:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:29:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] No VIF found with MAC fa:16:3e:f8:80:43, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:29:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bb2db32b-c275-46f9-9b3f-cd69ee1f2e6e tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.973s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:24 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a31def59-a32d-424f-b05b-05cae91f376b tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a31def59-a32d-424f-b05b-05cae91f376b tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a31def59-a32d-424f-b05b-05cae91f376b tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a31def59-a32d-424f-b05b-05cae91f376b tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75018) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a31def59-a32d-424f-b05b-05cae91f376b tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'flavor' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-1a99b592-f628-4113-8ec8-eb5cb480858c req-222bde7b-838d-4fd8-bdfe-3a4a3191973a service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-vif-unplugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1a99b592-f628-4113-8ec8-eb5cb480858c req-222bde7b-838d-4fd8-bdfe-3a4a3191973a service nova] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1a99b592-f628-4113-8ec8-eb5cb480858c req-222bde7b-838d-4fd8-bdfe-3a4a3191973a service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1a99b592-f628-4113-8ec8-eb5cb480858c req-222bde7b-838d-4fd8-bdfe-3a4a3191973a service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-1a99b592-f628-4113-8ec8-eb5cb480858c req-222bde7b-838d-4fd8-bdfe-3a4a3191973a service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] No waiting events found dispatching network-vif-unplugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:29:25 user nova-compute[75018]: WARNING nova.compute.manager [req-1a99b592-f628-4113-8ec8-eb5cb480858c req-222bde7b-838d-4fd8-bdfe-3a4a3191973a service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received unexpected event network-vif-unplugged-305ed47b-06ed-48aa-9584-70e46a35bded for instance with vm_state active and task_state powering-off.
Nov 07 15:29:25 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:25 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Instance destroyed successfully.
Nov 07 15:29:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a31def59-a32d-424f-b05b-05cae91f376b tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:29:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a31def59-a32d-424f-b05b-05cae91f376b tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.968s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:26 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:29:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:29:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:29:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:29:26 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updating instance_info_cache with network_info: [{"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG nova.compute.manager [req-18163299-0462-4a5b-a928-e66e0228f777 req-04afda0c-6452-4280-8bf3-be0f0bd85c0e service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-18163299-0462-4a5b-a928-e66e0228f777 req-04afda0c-6452-4280-8bf3-be0f0bd85c0e service nova] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-18163299-0462-4a5b-a928-e66e0228f777 req-04afda0c-6452-4280-8bf3-be0f0bd85c0e service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-18163299-0462-4a5b-a928-e66e0228f777 req-04afda0c-6452-4280-8bf3-be0f0bd85c0e service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG nova.compute.manager [req-18163299-0462-4a5b-a928-e66e0228f777 req-04afda0c-6452-4280-8bf3-be0f0bd85c0e service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] No waiting events found dispatching network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:29:27 user nova-compute[75018]: WARNING nova.compute.manager [req-18163299-0462-4a5b-a928-e66e0228f777 req-04afda0c-6452-4280-8bf3-be0f0bd85c0e service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received unexpected event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded for instance with vm_state stopped and task_state None.
Nov 07 15:29:27 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:29:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:29:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:29:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:29:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:31 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:29:31 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:29:31 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7562MB free_disk=25.147754669189453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 5212605c-c913-483f-874b-17af335aeb2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8257c590-204a-4fde-8487-79b8c0c87ea7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance af83bfa8-3661-4456-8854-f6c457e149fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance ca4ef7a3-718c-40c0-a2e0-bb636fc2214d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 55fb155e-ec0a-4d67-8427-c2158da7003a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:29:31 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:29:32 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:29:32 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:29:32 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:29:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.510s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:33 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:29:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:42 user nova-compute[75018]: INFO nova.compute.manager [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Rescuing
Nov 07 15:29:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:29:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquired lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:29:42 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:29:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Updating instance_info_cache with network_info: [{"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:29:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Releasing lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:29:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-1878f431-ce36-41ca-b8fb-f9bbb1a0bb54 req-c10c6c08-dff5-4e3e-8068-7f249d0bc7e5 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received event network-vif-unplugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:29:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1878f431-ce36-41ca-b8fb-f9bbb1a0bb54 req-c10c6c08-dff5-4e3e-8068-7f249d0bc7e5 service nova] Acquiring lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1878f431-ce36-41ca-b8fb-f9bbb1a0bb54 req-c10c6c08-dff5-4e3e-8068-7f249d0bc7e5 service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1878f431-ce36-41ca-b8fb-f9bbb1a0bb54 req-c10c6c08-dff5-4e3e-8068-7f249d0bc7e5 service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-1878f431-ce36-41ca-b8fb-f9bbb1a0bb54 req-c10c6c08-dff5-4e3e-8068-7f249d0bc7e5 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] No waiting events found dispatching network-vif-unplugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:29:43 user nova-compute[75018]: WARNING nova.compute.manager [req-1878f431-ce36-41ca-b8fb-f9bbb1a0bb54 req-c10c6c08-dff5-4e3e-8068-7f249d0bc7e5 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received unexpected event network-vif-unplugged-2ac8ec41-3720-4115-95a3-eef616ddb29e for instance with vm_state active and task_state rescuing.
Nov 07 15:29:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:44 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Instance destroyed successfully.
Nov 07 15:29:44 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Attempting rescue
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75018) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Instance directory exists: not creating {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 15:29:44 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Creating image(s)
Nov 07 15:29:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "/opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "/opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.190s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue" returned: 0 in 0.052s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'migration_context' on Instance uuid 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.objects.base [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<1e6465d9-6a61-4d6b-b876-ffdd9878fc28> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Start _get_guest_xml network_info=[{"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "vif_mac": "fa:16:3e:d6:97:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '667dc137-8627-496e-9a1f-9f5738befeda', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'resources' on Instance uuid 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.objects.base [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<1e6465d9-6a61-4d6b-b876-ffdd9878fc28> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.objects.base [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<1e6465d9-6a61-4d6b-b876-ffdd9878fc28> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:29:44 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:29:44 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.objects.base [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<1e6465d9-6a61-4d6b-b876-ffdd9878fc28> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-75372014',display_name='tempest-ServerRescueNegativeTestJSON-server-75372014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-75372014',id=18,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:28:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374a202b7d114f009ac374762e08c364',ramdisk_id='',reservation_id='r-1uwnu000',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1476352427',owner_user_name='tempest-ServerRescueNegativeTestJSON-1476352427-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:28:02Z,user_data=None,user_id='869a94fcb52246d583be8bac4a722a3c',uuid=1e6465d9-6a61-4d6b-b876-ffdd9878fc28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "vif_mac": "fa:16:3e:d6:97:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converting VIF {"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "vif_mac": "fa:16:3e:d6:97:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:97:7a,bridge_name='br-int',has_traffic_filtering=True,id=2ac8ec41-3720-4115-95a3-eef616ddb29e,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac8ec41-37') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.objects.base [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<1e6465d9-6a61-4d6b-b876-ffdd9878fc28> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:29:44 user nova-compute[75018]:   <uuid>1e6465d9-6a61-4d6b-b876-ffdd9878fc28</uuid>
Nov 07 15:29:44 user nova-compute[75018]:   <name>instance-00000012</name>
Nov 07 15:29:44 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:29:44 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:29:44 user nova-compute[75018]:   <metadata>
Nov 07 15:29:44 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:29:44 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:29:44 user nova-compute[75018]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-75372014</nova:name>
Nov 07 15:29:44 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:29:44</nova:creationTime>
Nov 07 15:29:44 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:29:44 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:29:44 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:29:44 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:29:44 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:29:44 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:29:44 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:29:44 user nova-compute[75018]:       <nova:owner>
Nov 07 15:29:44 user nova-compute[75018]:         <nova:user uuid="869a94fcb52246d583be8bac4a722a3c">tempest-ServerRescueNegativeTestJSON-1476352427-project-member</nova:user>
Nov 07 15:29:44 user nova-compute[75018]:         <nova:project uuid="374a202b7d114f009ac374762e08c364">tempest-ServerRescueNegativeTestJSON-1476352427</nova:project>
Nov 07 15:29:44 user nova-compute[75018]:       </nova:owner>
Nov 07 15:29:44 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:29:44 user nova-compute[75018]:       <nova:ports>
Nov 07 15:29:44 user nova-compute[75018]:         <nova:port uuid="2ac8ec41-3720-4115-95a3-eef616ddb29e">
Nov 07 15:29:44 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 07 15:29:44 user nova-compute[75018]:         </nova:port>
Nov 07 15:29:44 user nova-compute[75018]:       </nova:ports>
Nov 07 15:29:44 user nova-compute[75018]:     </nova:instance>
Nov 07 15:29:44 user nova-compute[75018]:   </metadata>
Nov 07 15:29:44 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:29:44 user nova-compute[75018]:     <system>
Nov 07 15:29:44 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:29:44 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:29:44 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:29:44 user nova-compute[75018]:       <entry name="serial">1e6465d9-6a61-4d6b-b876-ffdd9878fc28</entry>
Nov 07 15:29:44 user nova-compute[75018]:       <entry name="uuid">1e6465d9-6a61-4d6b-b876-ffdd9878fc28</entry>
Nov 07 15:29:44 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:29:44 user nova-compute[75018]:     </system>
Nov 07 15:29:44 user nova-compute[75018]:   </sysinfo>
Nov 07 15:29:44 user nova-compute[75018]:   <os>
Nov 07 15:29:44 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:29:44 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:29:44 user nova-compute[75018]:   </os>
Nov 07 15:29:44 user nova-compute[75018]:   <features>
Nov 07 15:29:44 user nova-compute[75018]:     <acpi/>
Nov 07 15:29:44 user nova-compute[75018]:     <apic/>
Nov 07 15:29:44 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:29:44 user nova-compute[75018]:   </features>
Nov 07 15:29:44 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:29:44 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:29:44 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:29:44 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:29:44 user nova-compute[75018]:   </clock>
Nov 07 15:29:44 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:29:44 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:29:44 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:29:44 user nova-compute[75018]:   </cpu>
Nov 07 15:29:44 user nova-compute[75018]:   <devices>
Nov 07 15:29:44 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:29:44 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:29:44 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue"/>
Nov 07 15:29:44 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:29:44 user nova-compute[75018]:     </disk>
Nov 07 15:29:44 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:29:44 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:29:44 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk"/>
Nov 07 15:29:44 user nova-compute[75018]:       <target dev="vdb" bus="virtio"/>
Nov 07 15:29:44 user nova-compute[75018]:     </disk>
Nov 07 15:29:44 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:29:44 user nova-compute[75018]:       <mac address="fa:16:3e:d6:97:7a"/>
Nov 07 15:29:44 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:29:44 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:29:44 user nova-compute[75018]:       <target dev="tap2ac8ec41-37"/>
Nov 07 15:29:44 user nova-compute[75018]:     </interface>
Nov 07 15:29:44 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:29:44 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/console.log" append="off"/>
Nov 07 15:29:44 user nova-compute[75018]:     </serial>
Nov 07 15:29:44 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:29:44 user nova-compute[75018]:     <video>
Nov 07 15:29:44 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:29:44 user nova-compute[75018]:     </video>
Nov 07 15:29:44 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:29:44 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:29:44 user nova-compute[75018]:     </rng>
Nov 07 15:29:44 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:29:44 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:29:44 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:29:44 user nova-compute[75018]:     </memballoon>
Nov 07 15:29:44 user nova-compute[75018]:   </devices>
Nov 07 15:29:44 user nova-compute[75018]: </domain>
Nov 07 15:29:44 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:29:44 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Instance destroyed successfully.
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:29:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No VIF found with MAC fa:16:3e:d6:97:7a, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:29:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-ac57788f-af2d-44a4-855b-fdb3f4b3a1fe req-c47bced8-be47-4b43-890b-7b86d6af6012 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received event network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:29:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ac57788f-af2d-44a4-855b-fdb3f4b3a1fe req-c47bced8-be47-4b43-890b-7b86d6af6012 service nova] Acquiring lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ac57788f-af2d-44a4-855b-fdb3f4b3a1fe req-c47bced8-be47-4b43-890b-7b86d6af6012 service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ac57788f-af2d-44a4-855b-fdb3f4b3a1fe req-c47bced8-be47-4b43-890b-7b86d6af6012 service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-ac57788f-af2d-44a4-855b-fdb3f4b3a1fe req-c47bced8-be47-4b43-890b-7b86d6af6012 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] No waiting events found dispatching network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:29:45 user nova-compute[75018]: WARNING nova.compute.manager [req-ac57788f-af2d-44a4-855b-fdb3f4b3a1fe req-c47bced8-be47-4b43-890b-7b86d6af6012 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received unexpected event network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e for instance with vm_state active and task_state rescuing.
Nov 07 15:29:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-e42c64f6-d55c-4028-b5d9-b142f33504c5 req-c42d2656-09ba-4a1f-b0de-b83b7c66f2d6 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received event network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:29:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e42c64f6-d55c-4028-b5d9-b142f33504c5 req-c42d2656-09ba-4a1f-b0de-b83b7c66f2d6 service nova] Acquiring lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e42c64f6-d55c-4028-b5d9-b142f33504c5 req-c42d2656-09ba-4a1f-b0de-b83b7c66f2d6 service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e42c64f6-d55c-4028-b5d9-b142f33504c5 req-c42d2656-09ba-4a1f-b0de-b83b7c66f2d6 service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-e42c64f6-d55c-4028-b5d9-b142f33504c5 req-c42d2656-09ba-4a1f-b0de-b83b7c66f2d6 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] No waiting events found dispatching network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:29:47 user nova-compute[75018]: WARNING nova.compute.manager [req-e42c64f6-d55c-4028-b5d9-b142f33504c5 req-c42d2656-09ba-4a1f-b0de-b83b7c66f2d6 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received unexpected event network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e for instance with vm_state active and task_state rescuing.
Nov 07 15:29:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-e42c64f6-d55c-4028-b5d9-b142f33504c5 req-c42d2656-09ba-4a1f-b0de-b83b7c66f2d6 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received event network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:29:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e42c64f6-d55c-4028-b5d9-b142f33504c5 req-c42d2656-09ba-4a1f-b0de-b83b7c66f2d6 service nova] Acquiring lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e42c64f6-d55c-4028-b5d9-b142f33504c5 req-c42d2656-09ba-4a1f-b0de-b83b7c66f2d6 service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e42c64f6-d55c-4028-b5d9-b142f33504c5 req-c42d2656-09ba-4a1f-b0de-b83b7c66f2d6 service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-e42c64f6-d55c-4028-b5d9-b142f33504c5 req-c42d2656-09ba-4a1f-b0de-b83b7c66f2d6 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] No waiting events found dispatching network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:29:47 user nova-compute[75018]: WARNING nova.compute.manager [req-e42c64f6-d55c-4028-b5d9-b142f33504c5 req-c42d2656-09ba-4a1f-b0de-b83b7c66f2d6 service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received unexpected event network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e for instance with vm_state active and task_state rescuing.
Nov 07 15:29:48 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c84b0384-7efa-476b-b376-939d752db917 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:29:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:49 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:29:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:50 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:29:50 user nova-compute[75018]: INFO nova.compute.claims [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Claim successful on node user
Nov 07 15:29:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:50 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:29:50 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:29:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.706s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:29:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:29:50 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:29:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:29:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:29:50 user nova-compute[75018]: DEBUG nova.policy [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6b39ca6e2db4be9a71fca8389bce83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da5c809b9e14547855ac986915e8c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:29:51 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Creating image(s)
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "/opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "/opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.245s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.238s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk 1073741824" returned: 0 in 0.073s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Successfully created port: 340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.265s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:29:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:29:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:29:52 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Cannot resize image /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:29:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:29:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Ensure instance console log exists: /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:29:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Successfully updated port: 340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:29:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "refresh_cache-ec5ab630-cd90-4514-aa9c-e46efc0bf78a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:29:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquired lock "refresh_cache-ec5ab630-cd90-4514-aa9c-e46efc0bf78a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:29:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-f4d5493d-4646-4f3a-8d36-14b148516b2e req-dffa4af8-3d72-453d-b7a2-b407704fd471 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-changed-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-f4d5493d-4646-4f3a-8d36-14b148516b2e req-dffa4af8-3d72-453d-b7a2-b407704fd471 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Refreshing instance network info cache due to event network-changed-340a2fcc-5b10-40db-90d7-646e5d265735. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f4d5493d-4646-4f3a-8d36-14b148516b2e req-dffa4af8-3d72-453d-b7a2-b407704fd471 service nova] Acquiring lock "refresh_cache-ec5ab630-cd90-4514-aa9c-e46efc0bf78a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Updating instance_info_cache with network_info: [{"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Releasing lock "refresh_cache-ec5ab630-cd90-4514-aa9c-e46efc0bf78a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Instance network_info: |[{"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f4d5493d-4646-4f3a-8d36-14b148516b2e req-dffa4af8-3d72-453d-b7a2-b407704fd471 service nova] Acquired lock "refresh_cache-ec5ab630-cd90-4514-aa9c-e46efc0bf78a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.network.neutron [req-f4d5493d-4646-4f3a-8d36-14b148516b2e req-dffa4af8-3d72-453d-b7a2-b407704fd471 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Refreshing network info cache for port 340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Start _get_guest_xml network_info=[{"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:29:53 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:29:53 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-517169496',display_name='tempest-tempest.common.compute-instance-517169496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-517169496',id=21,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1ib+IZkBUNZq/XSdHL5Mc3rWOjMKRZFDEv86GX4KYwSkRk0NwDBdXdk6iDYaPUir2kHQPF7s/yHU1b885XgqSAd/BtsiAhqj5T9Mo8OTRLSnj98TUeFLSeVstXTuztMA==',key_name='tempest-keypair-1509984004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-wrpoydl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:29:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=ec5ab630-cd90-4514-aa9c-e46efc0bf78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=340a2fcc-5b10-40db-90d7-646e5d265735,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340a2fcc-5b') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.objects.instance [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lazy-loading 'pci_devices' on Instance uuid ec5ab630-cd90-4514-aa9c-e46efc0bf78a {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:29:53 user nova-compute[75018]:   <uuid>ec5ab630-cd90-4514-aa9c-e46efc0bf78a</uuid>
Nov 07 15:29:53 user nova-compute[75018]:   <name>instance-00000015</name>
Nov 07 15:29:53 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:29:53 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:29:53 user nova-compute[75018]:   <metadata>
Nov 07 15:29:53 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:29:53 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:29:53 user nova-compute[75018]:       <nova:name>tempest-tempest.common.compute-instance-517169496</nova:name>
Nov 07 15:29:53 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:29:53</nova:creationTime>
Nov 07 15:29:53 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:29:53 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:29:53 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:29:53 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:29:53 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:29:53 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:29:53 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:29:53 user nova-compute[75018]:       <nova:owner>
Nov 07 15:29:53 user nova-compute[75018]:         <nova:user uuid="c6b39ca6e2db4be9a71fca8389bce83f">tempest-ServerActionsTestOtherA-1198683339-project-member</nova:user>
Nov 07 15:29:53 user nova-compute[75018]:         <nova:project uuid="8da5c809b9e14547855ac986915e8c99">tempest-ServerActionsTestOtherA-1198683339</nova:project>
Nov 07 15:29:53 user nova-compute[75018]:       </nova:owner>
Nov 07 15:29:53 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:29:53 user nova-compute[75018]:       <nova:ports>
Nov 07 15:29:53 user nova-compute[75018]:         <nova:port uuid="340a2fcc-5b10-40db-90d7-646e5d265735">
Nov 07 15:29:53 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 15:29:53 user nova-compute[75018]:         </nova:port>
Nov 07 15:29:53 user nova-compute[75018]:       </nova:ports>
Nov 07 15:29:53 user nova-compute[75018]:     </nova:instance>
Nov 07 15:29:53 user nova-compute[75018]:   </metadata>
Nov 07 15:29:53 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:29:53 user nova-compute[75018]:     <system>
Nov 07 15:29:53 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:29:53 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:29:53 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:29:53 user nova-compute[75018]:       <entry name="serial">ec5ab630-cd90-4514-aa9c-e46efc0bf78a</entry>
Nov 07 15:29:53 user nova-compute[75018]:       <entry name="uuid">ec5ab630-cd90-4514-aa9c-e46efc0bf78a</entry>
Nov 07 15:29:53 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:29:53 user nova-compute[75018]:     </system>
Nov 07 15:29:53 user nova-compute[75018]:   </sysinfo>
Nov 07 15:29:53 user nova-compute[75018]:   <os>
Nov 07 15:29:53 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:29:53 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:29:53 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:29:53 user nova-compute[75018]:   </os>
Nov 07 15:29:53 user nova-compute[75018]:   <features>
Nov 07 15:29:53 user nova-compute[75018]:     <acpi/>
Nov 07 15:29:53 user nova-compute[75018]:     <apic/>
Nov 07 15:29:53 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:29:53 user nova-compute[75018]:   </features>
Nov 07 15:29:53 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:29:53 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:29:53 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:29:53 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:29:53 user nova-compute[75018]:   </clock>
Nov 07 15:29:53 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:29:53 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:29:53 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:29:53 user nova-compute[75018]:   </cpu>
Nov 07 15:29:53 user nova-compute[75018]:   <devices>
Nov 07 15:29:53 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:29:53 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:29:53 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk"/>
Nov 07 15:29:53 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:29:53 user nova-compute[75018]:     </disk>
Nov 07 15:29:53 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:29:53 user nova-compute[75018]:       <mac address="fa:16:3e:0e:3b:23"/>
Nov 07 15:29:53 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:29:53 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:29:53 user nova-compute[75018]:       <target dev="tap340a2fcc-5b"/>
Nov 07 15:29:53 user nova-compute[75018]:     </interface>
Nov 07 15:29:53 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:29:53 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/console.log" append="off"/>
Nov 07 15:29:53 user nova-compute[75018]:     </serial>
Nov 07 15:29:53 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:29:53 user nova-compute[75018]:     <video>
Nov 07 15:29:53 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:29:53 user nova-compute[75018]:     </video>
Nov 07 15:29:53 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:29:53 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:29:53 user nova-compute[75018]:     </rng>
Nov 07 15:29:53 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:29:53 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:29:53 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:29:53 user nova-compute[75018]:     </memballoon>
Nov 07 15:29:53 user nova-compute[75018]:   </devices>
Nov 07 15:29:53 user nova-compute[75018]: </domain>
Nov 07 15:29:53 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-517169496',display_name='tempest-tempest.common.compute-instance-517169496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-517169496',id=21,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1ib+IZkBUNZq/XSdHL5Mc3rWOjMKRZFDEv86GX4KYwSkRk0NwDBdXdk6iDYaPUir2kHQPF7s/yHU1b885XgqSAd/BtsiAhqj5T9Mo8OTRLSnj98TUeFLSeVstXTuztMA==',key_name='tempest-keypair-1509984004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-wrpoydl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:29:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=ec5ab630-cd90-4514-aa9c-e46efc0bf78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=340a2fcc-5b10-40db-90d7-646e5d265735,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340a2fcc-5b') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG os_vif [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=340a2fcc-5b10-40db-90d7-646e5d265735,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340a2fcc-5b') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd805614-c413-56a2-a3a9-33a968a96c31', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap340a2fcc-5b, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap340a2fcc-5b, col_values=(('qos', UUID('4dcb6e4b-6bb8-45ff-ac45-60cf0983a50f')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap340a2fcc-5b, col_values=(('external_ids', {'iface-id': '340a2fcc-5b10-40db-90d7-646e5d265735', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:3b:23', 'vm-uuid': 'ec5ab630-cd90-4514-aa9c-e46efc0bf78a'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:53 user nova-compute[75018]: INFO os_vif [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=340a2fcc-5b10-40db-90d7-646e5d265735,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340a2fcc-5b')
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] No VIF found with MAC fa:16:3e:0e:3b:23, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.network.neutron [req-f4d5493d-4646-4f3a-8d36-14b148516b2e req-dffa4af8-3d72-453d-b7a2-b407704fd471 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Updated VIF entry in instance network info cache for port 340a2fcc-5b10-40db-90d7-646e5d265735. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG nova.network.neutron [req-f4d5493d-4646-4f3a-8d36-14b148516b2e req-dffa4af8-3d72-453d-b7a2-b407704fd471 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Updating instance_info_cache with network_info: [{"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:29:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f4d5493d-4646-4f3a-8d36-14b148516b2e req-dffa4af8-3d72-453d-b7a2-b407704fd471 service nova] Releasing lock "refresh_cache-ec5ab630-cd90-4514-aa9c-e46efc0bf78a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:29:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-4955c642-5898-4bf4-a443-56d235e0f4f9 req-0b889be8-66ff-470c-a335-6c668ff05664 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:29:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4955c642-5898-4bf4-a443-56d235e0f4f9 req-0b889be8-66ff-470c-a335-6c668ff05664 service nova] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4955c642-5898-4bf4-a443-56d235e0f4f9 req-0b889be8-66ff-470c-a335-6c668ff05664 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4955c642-5898-4bf4-a443-56d235e0f4f9 req-0b889be8-66ff-470c-a335-6c668ff05664 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-4955c642-5898-4bf4-a443-56d235e0f4f9 req-0b889be8-66ff-470c-a335-6c668ff05664 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] No waiting events found dispatching network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:29:55 user nova-compute[75018]: WARNING nova.compute.manager [req-4955c642-5898-4bf4-a443-56d235e0f4f9 req-0b889be8-66ff-470c-a335-6c668ff05664 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received unexpected event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 for instance with vm_state building and task_state spawning.
Nov 07 15:29:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:29:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-b42d23e8-ba61-4734-a881-55d5a6186aea req-720533f2-7d4e-4e04-b2ed-fc5d46ce0a60 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:29:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b42d23e8-ba61-4734-a881-55d5a6186aea req-720533f2-7d4e-4e04-b2ed-fc5d46ce0a60 service nova] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:29:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b42d23e8-ba61-4734-a881-55d5a6186aea req-720533f2-7d4e-4e04-b2ed-fc5d46ce0a60 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:29:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b42d23e8-ba61-4734-a881-55d5a6186aea req-720533f2-7d4e-4e04-b2ed-fc5d46ce0a60 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-b42d23e8-ba61-4734-a881-55d5a6186aea req-720533f2-7d4e-4e04-b2ed-fc5d46ce0a60 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] No waiting events found dispatching network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:29:57 user nova-compute[75018]: WARNING nova.compute.manager [req-b42d23e8-ba61-4734-a881-55d5a6186aea req-720533f2-7d4e-4e04-b2ed-fc5d46ce0a60 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received unexpected event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 for instance with vm_state building and task_state spawning.
Nov 07 15:29:57 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:29:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:29:57 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Instance spawned successfully.
Nov 07 15:29:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:29:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:29:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:29:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:29:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:29:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:29:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:29:57 user nova-compute[75018]: INFO nova.compute.manager [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Took 6.68 seconds to spawn the instance on the hypervisor.
Nov 07 15:29:57 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:29:57 user nova-compute[75018]: INFO nova.compute.manager [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Took 7.88 seconds to build instance.
Nov 07 15:29:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5159c3b4-9644-4c75-ae5e-9d4ef26a5dce tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.028s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:29:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:23 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:30:23 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:30:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:30:24 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:30:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:25 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:30:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:25 user nova-compute[75018]: INFO nova.compute.manager [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Terminating instance
Nov 07 15:30:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG nova.compute.manager [req-34e7c184-8f68-4fdc-b748-4d6d3b72aa91 req-d43a69a5-1f24-4b88-8bd4-354dc998e818 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-vif-unplugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-34e7c184-8f68-4fdc-b748-4d6d3b72aa91 req-d43a69a5-1f24-4b88-8bd4-354dc998e818 service nova] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-34e7c184-8f68-4fdc-b748-4d6d3b72aa91 req-d43a69a5-1f24-4b88-8bd4-354dc998e818 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-34e7c184-8f68-4fdc-b748-4d6d3b72aa91 req-d43a69a5-1f24-4b88-8bd4-354dc998e818 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG nova.compute.manager [req-34e7c184-8f68-4fdc-b748-4d6d3b72aa91 req-d43a69a5-1f24-4b88-8bd4-354dc998e818 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] No waiting events found dispatching network-vif-unplugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG nova.compute.manager [req-34e7c184-8f68-4fdc-b748-4d6d3b72aa91 req-d43a69a5-1f24-4b88-8bd4-354dc998e818 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-vif-unplugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:30:26 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Instance destroyed successfully.
Nov 07 15:30:26 user nova-compute[75018]: DEBUG nova.objects.instance [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lazy-loading 'resources' on Instance uuid 8257c590-204a-4fde-8487-79b8c0c87ea7 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077045494',display_name='tempest-ServerActionsTestOtherB-server-2077045494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077045494',id=1,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyBOTPm1HGMtOU1eTQJ9qDH8GeBUu2t+LNMgZBFFRP6tXXqDAukKUUiPODmfxQ+bXcX5mB9tkmMwlkDaHeyRpZSXxAXFTca2PcoYOgGrbYpszpri/wTQI3HjvvfuDY7fQ==',key_name='tempest-keypair-1660361084',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:28:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='585cee0db41e41dda7f10ecfc90f1daf',ramdisk_id='',reservation_id='r-rh7e0y4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1343289164',owner_user_name='tempest-ServerActionsTestOtherB-1343289164-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:28:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b867fc1e0742c3a3c5b76ed6fb756e',uuid=8257c590-204a-4fde-8487-79b8c0c87ea7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converting VIF {"id": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "address": "fa:16:3e:a6:52:2c", "network": {"id": "0ecb8919-0683-408d-9e46-43035df0dcbd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-370627506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "585cee0db41e41dda7f10ecfc90f1daf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05429ce8-06", "ovs_interfaceid": "05429ce8-06b2-4693-bf2c-5d03a4343e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG os_vif [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05429ce8-06, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33aed2c9-5c6b-4fb2-af93-289a81f10bdd) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:26 user nova-compute[75018]: INFO os_vif [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=05429ce8-06b2-4693-bf2c-5d03a4343e00,network=Network(0ecb8919-0683-408d-9e46-43035df0dcbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05429ce8-06')
Nov 07 15:30:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXUpZxbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:30:26 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:30:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c746ff-af46-4bd3-9157-c8fc4fd8e2ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:30:26 user nova-compute[75018]: No targets found.
Nov 07 15:30:26 user nova-compute[75018]: iSNS:
Nov 07 15:30:26 user nova-compute[75018]: No targets found.
Nov 07 15:30:26 user nova-compute[75018]: STATIC:
Nov 07 15:30:26 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f
Nov 07 15:30:26 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:30:26 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:30:26 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11
Nov 07 15:30:26 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:30:26 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:30:26 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf
Nov 07 15:30:26 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:30:26 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:30:26 user nova-compute[75018]: FIRMWARE:
Nov 07 15:30:26 user nova-compute[75018]: No targets found.
Nov 07 15:30:26 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:30:26 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:30:26 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[45905044-a81d-4009-9d2c-d35ae7ed57eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[62882d46-fbf0-47af-b6c3-169a75daf8cb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:30:27 user nova-compute[75018]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:30:27 user nova-compute[75018]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:30:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf (non-flash)
Nov 07 15:30:27 user nova-compute[75018]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:30:27 user nova-compute[75018]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:30:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae0332680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b92f4b-6b0c-46bf-b5f5-f32153ef23fc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1d124a-6451-49d6-9617-00cf24bf688a]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24eb53-3fcd-49f0-87d8-8090dce1da79]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4155a4c9-d1f8-417e-be73-ede5eac94b42]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc26f793-ce6f-4bf6-82db-cec2b43f1317]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1a8077-ea81-44a9-a7c5-b6242251c065]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260]
Nov 07 15:30:27 user nova-compute[75018]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf, portal: 172.16.0.220,3260] successful.
Nov 07 15:30:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d80c58-1c6c-42a4-b6b0-0ab642ac4cdf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[54597866-a95f-494e-9ea8-7bfbaa1912f5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] <== disconnect_volume: return (314ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:30:27 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Deleting instance files /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7_del
Nov 07 15:30:27 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Deletion of /opt/stack/data/nova/instances/8257c590-204a-4fde-8487-79b8c0c87ea7_del complete
Nov 07 15:30:27 user nova-compute[75018]: INFO nova.compute.manager [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 07 15:30:27 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:30:27 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:30:28 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:30:28 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Took 0.87 seconds to deallocate network for instance.
Nov 07 15:30:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-c3f48e0a-81b5-4dd2-918f-b1fc152b13ab req-598a9212-d275-49e0-a0bd-d8ad84de6e32 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c3f48e0a-81b5-4dd2-918f-b1fc152b13ab req-598a9212-d275-49e0-a0bd-d8ad84de6e32 service nova] Acquiring lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c3f48e0a-81b5-4dd2-918f-b1fc152b13ab req-598a9212-d275-49e0-a0bd-d8ad84de6e32 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c3f48e0a-81b5-4dd2-918f-b1fc152b13ab req-598a9212-d275-49e0-a0bd-d8ad84de6e32 service nova] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-c3f48e0a-81b5-4dd2-918f-b1fc152b13ab req-598a9212-d275-49e0-a0bd-d8ad84de6e32 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] No waiting events found dispatching network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:30:28 user nova-compute[75018]: WARNING nova.compute.manager [req-c3f48e0a-81b5-4dd2-918f-b1fc152b13ab req-598a9212-d275-49e0-a0bd-d8ad84de6e32 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received unexpected event network-vif-plugged-05429ce8-06b2-4693-bf2c-5d03a4343e00 for instance with vm_state active and task_state deleting.
Nov 07 15:30:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-c3f48e0a-81b5-4dd2-918f-b1fc152b13ab req-598a9212-d275-49e0-a0bd-d8ad84de6e32 service nova] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Received event network-vif-deleted-05429ce8-06b2-4693-bf2c-5d03a4343e00 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:28 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:30:28 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:30:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:30:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:30:28 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:30:29 user nova-compute[75018]: INFO nova.compute.manager [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] [instance: 8257c590-204a-4fde-8487-79b8c0c87ea7] Took 1.00 seconds to detach 1 volumes for instance.
Nov 07 15:30:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updating instance_info_cache with network_info: [{"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.310s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:30:29 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Deleted allocations for instance 8257c590-204a-4fde-8487-79b8c0c87ea7
Nov 07 15:30:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-73e9e9eb-0ff9-452d-80c8-f903589a226c tempest-ServerActionsTestOtherB-1343289164 tempest-ServerActionsTestOtherB-1343289164-project-member] Lock "8257c590-204a-4fde-8487-79b8c0c87ea7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.794s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:30:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:30 user nova-compute[75018]: INFO nova.compute.manager [None req-ce567e02-b071-4866-8e02-3c3b091bb59e tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Unrescuing
Nov 07 15:30:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ce567e02-b071-4866-8e02-3c3b091bb59e tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:30:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ce567e02-b071-4866-8e02-3c3b091bb59e tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquired lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:30:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ce567e02-b071-4866-8e02-3c3b091bb59e tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:30:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ce567e02-b071-4866-8e02-3c3b091bb59e tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updating instance_info_cache with network_info: [{"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ce567e02-b071-4866-8e02-3c3b091bb59e tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Releasing lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ce567e02-b071-4866-8e02-3c3b091bb59e tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lazy-loading 'flavor' on Instance uuid 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG nova.compute.manager [req-f6087356-7137-49c5-b172-52bf1a3ac5aa req-e24a8f8a-0535-4857-bf08-065fc5ff74a9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-vif-unplugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f6087356-7137-49c5-b172-52bf1a3ac5aa req-e24a8f8a-0535-4857-bf08-065fc5ff74a9 service nova] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f6087356-7137-49c5-b172-52bf1a3ac5aa req-e24a8f8a-0535-4857-bf08-065fc5ff74a9 service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f6087356-7137-49c5-b172-52bf1a3ac5aa req-e24a8f8a-0535-4857-bf08-065fc5ff74a9 service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG nova.compute.manager [req-f6087356-7137-49c5-b172-52bf1a3ac5aa req-e24a8f8a-0535-4857-bf08-065fc5ff74a9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] No waiting events found dispatching network-vif-unplugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:30:31 user nova-compute[75018]: WARNING nova.compute.manager [req-f6087356-7137-49c5-b172-52bf1a3ac5aa req-e24a8f8a-0535-4857-bf08-065fc5ff74a9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received unexpected event network-vif-unplugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:30:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:32 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Instance destroyed successfully.
Nov 07 15:30:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ce567e02-b071-4866-8e02-3c3b091bb59e tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] No waiting events found dispatching network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:30:36 user nova-compute[75018]: WARNING nova.compute.manager [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received unexpected event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-changed-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Refreshing instance network info cache due to event network-changed-97ce6c8c-ae6c-444d-a746-0c41c90dad44. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] Acquiring lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] Acquired lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.network.neutron [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Refreshing network info cache for port 97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-877e9e34-f644-4de7-9058-c1517e111059 req-c6a324ed-1385-45c4-82f9-206b9f366a53 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-877e9e34-f644-4de7-9058-c1517e111059 req-c6a324ed-1385-45c4-82f9-206b9f366a53 service nova] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-877e9e34-f644-4de7-9058-c1517e111059 req-c6a324ed-1385-45c4-82f9-206b9f366a53 service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-877e9e34-f644-4de7-9058-c1517e111059 req-c6a324ed-1385-45c4-82f9-206b9f366a53 service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-877e9e34-f644-4de7-9058-c1517e111059 req-c6a324ed-1385-45c4-82f9-206b9f366a53 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] No waiting events found dispatching network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:30:36 user nova-compute[75018]: WARNING nova.compute.manager [req-877e9e34-f644-4de7-9058-c1517e111059 req-c6a324ed-1385-45c4-82f9-206b9f366a53 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received unexpected event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-877e9e34-f644-4de7-9058-c1517e111059 req-c6a324ed-1385-45c4-82f9-206b9f366a53 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-877e9e34-f644-4de7-9058-c1517e111059 req-c6a324ed-1385-45c4-82f9-206b9f366a53 service nova] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-877e9e34-f644-4de7-9058-c1517e111059 req-c6a324ed-1385-45c4-82f9-206b9f366a53 service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-877e9e34-f644-4de7-9058-c1517e111059 req-c6a324ed-1385-45c4-82f9-206b9f366a53 service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-877e9e34-f644-4de7-9058-c1517e111059 req-c6a324ed-1385-45c4-82f9-206b9f366a53 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] No waiting events found dispatching network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:30:36 user nova-compute[75018]: WARNING nova.compute.manager [req-877e9e34-f644-4de7-9058-c1517e111059 req-c6a324ed-1385-45c4-82f9-206b9f366a53 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received unexpected event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:30:36 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:30:36 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7622MB free_disk=25.13384246826172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 5212605c-c913-483f-874b-17af335aeb2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance af83bfa8-3661-4456-8854-f6c457e149fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance ca4ef7a3-718c-40c0-a2e0-bb636fc2214d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 55fb155e-ec0a-4d67-8427-c2158da7003a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:30:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updated VIF entry in instance network info cache for port 97ce6c8c-ae6c-444d-a746-0c41c90dad44. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updating instance_info_cache with network_info: [{"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] Releasing lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-changed-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Refreshing instance network info cache due to event network-changed-97ce6c8c-ae6c-444d-a746-0c41c90dad44. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] Acquiring lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] Acquired lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Refreshing network info cache for port 97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.669s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updated VIF entry in instance network info cache for port 97ce6c8c-ae6c-444d-a746-0c41c90dad44. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG nova.network.neutron [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updating instance_info_cache with network_info: [{"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:30:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8dfbfcde-afbd-478d-a0ac-83b5d5e0492a req-a6b7d1eb-dfbb-4415-a95e-6cadb1b113f9 service nova] Releasing lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.compute.manager [req-a10cf440-4667-4db1-a106-7db723f07303 req-446d678d-bae7-466f-a93b-d1ed3b840811 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-changed-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.compute.manager [req-a10cf440-4667-4db1-a106-7db723f07303 req-446d678d-bae7-466f-a93b-d1ed3b840811 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Refreshing instance network info cache due to event network-changed-1a222150-39b6-4eb8-8502-379bd9f9f468. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a10cf440-4667-4db1-a106-7db723f07303 req-446d678d-bae7-466f-a93b-d1ed3b840811 service nova] Acquiring lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a10cf440-4667-4db1-a106-7db723f07303 req-446d678d-bae7-466f-a93b-d1ed3b840811 service nova] Acquired lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.network.neutron [req-a10cf440-4667-4db1-a106-7db723f07303 req-446d678d-bae7-466f-a93b-d1ed3b840811 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Refreshing network info cache for port 1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:30:38 user nova-compute[75018]: INFO nova.compute.manager [None req-b6afd878-487d-422a-9494-b9d956bf003e tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Get console output
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "5212605c-c913-483f-874b-17af335aeb2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "5212605c-c913-483f-874b-17af335aeb2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "5212605c-c913-483f-874b-17af335aeb2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "5212605c-c913-483f-874b-17af335aeb2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "5212605c-c913-483f-874b-17af335aeb2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:38 user nova-compute[75018]: INFO nova.compute.manager [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Terminating instance
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [-] [instance: 5212605c-c913-483f-874b-17af335aeb2f] During wait destroy, instance disappeared. {{(pid=75018) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 07 15:30:38 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Instance destroyed successfully.
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.objects.instance [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lazy-loading 'resources' on Instance uuid 5212605c-c913-483f-874b-17af335aeb2f {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T15:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-994735681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-655130991',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPv8aFD5LWaVVjpuImyl8D4RlPV5xNYVN7NKvQFHB8zaOHQSYdricv6FD20zXu/XqDM3rUoyy7wL0y3axEvbla/s7QURGC98f2Y4d2r6/lV5ouvT8UGE1tcxwINR8RXzg==',key_name='tempest-keypair-2093191890',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='5abdb560dcda4650a47cc53ae59c9783',ramdisk_id='',reservation_id='r-acj23alz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1927257890',owner_user_name='tempest-ServerActionsV293TestJSON-1927257890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa101c0dd31f4796803bf3b600e5b439',uuid=5212605c-c913-483f-874b-17af335aeb2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57d57fc6-3705-4b40-9d00-44c182114a8a", "address": "fa:16:3e:90:c3:82", "network": {"id": "10ccf061-c522-4a5b-ba65-4d89ef2fb661", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-853530484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abdb560dcda4650a47cc53ae59c9783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d57fc6-37", "ovs_interfaceid": "57d57fc6-3705-4b40-9d00-44c182114a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Converting VIF {"id": "57d57fc6-3705-4b40-9d00-44c182114a8a", "address": "fa:16:3e:90:c3:82", "network": {"id": "10ccf061-c522-4a5b-ba65-4d89ef2fb661", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-853530484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abdb560dcda4650a47cc53ae59c9783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d57fc6-37", "ovs_interfaceid": "57d57fc6-3705-4b40-9d00-44c182114a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:c3:82,bridge_name='br-int',has_traffic_filtering=True,id=57d57fc6-3705-4b40-9d00-44c182114a8a,network=Network(10ccf061-c522-4a5b-ba65-4d89ef2fb661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d57fc6-37') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG os_vif [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c3:82,bridge_name='br-int',has_traffic_filtering=True,id=57d57fc6-3705-4b40-9d00-44c182114a8a,network=Network(10ccf061-c522-4a5b-ba65-4d89ef2fb661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d57fc6-37') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57d57fc6-37, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:30:38 user nova-compute[75018]: INFO os_vif [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c3:82,bridge_name='br-int',has_traffic_filtering=True,id=57d57fc6-3705-4b40-9d00-44c182114a8a,network=Network(10ccf061-c522-4a5b-ba65-4d89ef2fb661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d57fc6-37')
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWNgZhKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:30:38 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:30:38 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f5b17e-475b-4e28-80a6-67d09c91ad03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:30:38 user nova-compute[75018]: No targets found.
Nov 07 15:30:38 user nova-compute[75018]: iSNS:
Nov 07 15:30:38 user nova-compute[75018]: No targets found.
Nov 07 15:30:38 user nova-compute[75018]: STATIC:
Nov 07 15:30:38 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f
Nov 07 15:30:38 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:30:38 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:30:38 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11
Nov 07 15:30:38 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:30:38 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:30:38 user nova-compute[75018]: FIRMWARE:
Nov 07 15:30:38 user nova-compute[75018]: No targets found.
Nov 07 15:30:38 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:30:38 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:30:38 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd6809db-5bfd-4f25-a699-665747ec0582', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd02b008-fff5-42dc-8f3b-b847fee53ce4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[014fc219-d448-49eb-8056-375bb8328d71]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:30:38 user nova-compute[75018]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:30:38 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:30:38 user nova-compute[75018]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:30:38 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb0184af80>, {}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Disconnecting from: [] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.097s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] <== disconnect_volume: return (99ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:30:38 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Deletion of /opt/stack/data/nova/instances/5212605c-c913-483f-874b-17af335aeb2f_del complete
Nov 07 15:30:38 user nova-compute[75018]: INFO nova.compute.manager [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Took 0.22 seconds to destroy the instance on the hypervisor.
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 5212605c-c913-483f-874b-17af335aeb2f] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.network.neutron [req-a10cf440-4667-4db1-a106-7db723f07303 req-446d678d-bae7-466f-a93b-d1ed3b840811 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Updated VIF entry in instance network info cache for port 1a222150-39b6-4eb8-8502-379bd9f9f468. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG nova.network.neutron [req-a10cf440-4667-4db1-a106-7db723f07303 req-446d678d-bae7-466f-a93b-d1ed3b840811 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Updating instance_info_cache with network_info: [{"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:30:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a10cf440-4667-4db1-a106-7db723f07303 req-446d678d-bae7-466f-a93b-d1ed3b840811 service nova] Releasing lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:30:39 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:30:39 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Took 1.35 seconds to deallocate network for instance.
Nov 07 15:30:40 user nova-compute[75018]: INFO nova.compute.manager [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Took 0.11 seconds to detach 1 volumes for instance.
Nov 07 15:30:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Deleting volume: cd6809db-5bfd-4f25-a699-665747ec0582 {{(pid=75018) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 07 15:30:40 user nova-compute[75018]: DEBUG nova.compute.manager [req-7ad00083-b188-44a4-9e21-d4972f481270 req-59b66338-60b8-4600-b2c7-bba1b458c8ff service nova] [instance: 5212605c-c913-483f-874b-17af335aeb2f] Received event network-vif-deleted-57d57fc6-3705-4b40-9d00-44c182114a8a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:40 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:30:40 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:30:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:40 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Deleted allocations for instance 5212605c-c913-483f-874b-17af335aeb2f
Nov 07 15:30:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-372514b7-5e26-467e-b240-3957db819f0c tempest-ServerActionsV293TestJSON-1927257890 tempest-ServerActionsV293TestJSON-1927257890-project-member] Lock "5212605c-c913-483f-874b-17af335aeb2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.603s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:42 user nova-compute[75018]: DEBUG nova.compute.manager [req-ed95f425-f816-4354-a662-5aa66f57cfcb req-cbd246ff-4593-465f-ab3d-be7ea9efbb76 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Received event network-changed-62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:42 user nova-compute[75018]: DEBUG nova.compute.manager [req-ed95f425-f816-4354-a662-5aa66f57cfcb req-cbd246ff-4593-465f-ab3d-be7ea9efbb76 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Refreshing instance network info cache due to event network-changed-62ebf755-0030-4d56-bf5d-bbd25c14c1ef. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:30:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ed95f425-f816-4354-a662-5aa66f57cfcb req-cbd246ff-4593-465f-ab3d-be7ea9efbb76 service nova] Acquiring lock "refresh_cache-55fb155e-ec0a-4d67-8427-c2158da7003a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:30:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ed95f425-f816-4354-a662-5aa66f57cfcb req-cbd246ff-4593-465f-ab3d-be7ea9efbb76 service nova] Acquired lock "refresh_cache-55fb155e-ec0a-4d67-8427-c2158da7003a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:30:42 user nova-compute[75018]: DEBUG nova.network.neutron [req-ed95f425-f816-4354-a662-5aa66f57cfcb req-cbd246ff-4593-465f-ab3d-be7ea9efbb76 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Refreshing network info cache for port 62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:30:43 user nova-compute[75018]: DEBUG nova.network.neutron [req-ed95f425-f816-4354-a662-5aa66f57cfcb req-cbd246ff-4593-465f-ab3d-be7ea9efbb76 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Updated VIF entry in instance network info cache for port 62ebf755-0030-4d56-bf5d-bbd25c14c1ef. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:30:43 user nova-compute[75018]: DEBUG nova.network.neutron [req-ed95f425-f816-4354-a662-5aa66f57cfcb req-cbd246ff-4593-465f-ab3d-be7ea9efbb76 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Updating instance_info_cache with network_info: [{"id": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "address": "fa:16:3e:31:e2:74", "network": {"id": "4d4dfcec-fc10-48d8-88aa-a55b766a3bd3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-591672914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb8653b534c4619abf6bc1d943bd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ebf755-00", "ovs_interfaceid": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:30:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ed95f425-f816-4354-a662-5aa66f57cfcb req-cbd246ff-4593-465f-ab3d-be7ea9efbb76 service nova] Releasing lock "refresh_cache-55fb155e-ec0a-4d67-8427-c2158da7003a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:30:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:44 user nova-compute[75018]: INFO nova.compute.manager [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Shelving
Nov 07 15:30:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-2b223050-3d7d-46ab-a525-3dfb7fdab62b req-32cba8b4-8ce9-4407-a29e-8f98c163b4a1 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-vif-unplugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2b223050-3d7d-46ab-a525-3dfb7fdab62b req-32cba8b4-8ce9-4407-a29e-8f98c163b4a1 service nova] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2b223050-3d7d-46ab-a525-3dfb7fdab62b req-32cba8b4-8ce9-4407-a29e-8f98c163b4a1 service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2b223050-3d7d-46ab-a525-3dfb7fdab62b req-32cba8b4-8ce9-4407-a29e-8f98c163b4a1 service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-2b223050-3d7d-46ab-a525-3dfb7fdab62b req-32cba8b4-8ce9-4407-a29e-8f98c163b4a1 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] No waiting events found dispatching network-vif-unplugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:30:45 user nova-compute[75018]: WARNING nova.compute.manager [req-2b223050-3d7d-46ab-a525-3dfb7fdab62b req-32cba8b4-8ce9-4407-a29e-8f98c163b4a1 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received unexpected event network-vif-unplugged-1a222150-39b6-4eb8-8502-379bd9f9f468 for instance with vm_state active and task_state shelving.
Nov 07 15:30:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Instance destroyed successfully.
Nov 07 15:30:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Beginning cold snapshot process
Nov 07 15:30:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:45 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:30:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk /opt/stack/data/nova/instances/snapshots/tmp6ga0o_79/06e6705c0dd749c29375eff3ef56ba04 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk /opt/stack/data/nova/instances/snapshots/tmp6ga0o_79/06e6705c0dd749c29375eff3ef56ba04" returned: 0 in 0.892s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:46 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Snapshot extracted, beginning image upload
Nov 07 15:30:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] No waiting events found dispatching network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:30:47 user nova-compute[75018]: WARNING nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received unexpected event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 for instance with vm_state active and task_state shelving_image_uploading.
Nov 07 15:30:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] No waiting events found dispatching network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:30:47 user nova-compute[75018]: WARNING nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received unexpected event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 for instance with vm_state active and task_state shelving_image_uploading.
Nov 07 15:30:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] No waiting events found dispatching network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:30:47 user nova-compute[75018]: WARNING nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received unexpected event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 for instance with vm_state active and task_state shelving_image_uploading.
Nov 07 15:30:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-vif-unplugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] No waiting events found dispatching network-vif-unplugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:30:47 user nova-compute[75018]: WARNING nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received unexpected event network-vif-unplugged-1a222150-39b6-4eb8-8502-379bd9f9f468 for instance with vm_state active and task_state shelving_image_uploading.
Nov 07 15:30:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] No waiting events found dispatching network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:30:47 user nova-compute[75018]: WARNING nova.compute.manager [req-4016fe7a-f817-415d-b044-51546a17a2fb req-9812bfbb-c83e-4a2d-8c4e-c24c31bf4f9e service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received unexpected event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 for instance with vm_state active and task_state shelving_image_uploading.
Nov 07 15:30:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Snapshot image upload complete
Nov 07 15:30:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:30:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:50 user nova-compute[75018]: INFO nova.compute.manager [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Shelve offloading
Nov 07 15:30:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Instance destroyed successfully.
Nov 07 15:30:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:30:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:30:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquired lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:30:50 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Updating instance_info_cache with network_info: [{"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Releasing lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:30:51 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Instance destroyed successfully.
Nov 07 15:30:51 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'resources' on Instance uuid ca4ef7a3-718c-40c0-a2e0-bb636fc2214d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:28:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-69325560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-69325560',id=19,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaOv2W2tLVLZXeJouTLzkDUUJ5/sVjsATl2Nzga1jOlwbQ4D+LsMnHpvBFVTtTOkra++qIzs0qRkNi3BAnUQDH52yljVA+1NpUjMXRdcnhtKUGecCiOuRrqaFwZkBSrIA==',key_name='tempest-keypair-685240993',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:28:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e1d8e2c039d94beea94f85d8d5a95d95',ramdisk_id='',reservation_id='r-n25mco0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-175335890',owner_user_name='tempest-AttachVolumeShelveTestJSON-175335890-project-member',shelved_at='2023-11-07T15:30:50.440145',shelved_host='user',shelved_image_id='b35d981f-bfc5-444c-bd06-372690a5e8f6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c7596f1e0e748728fa459908f89aede',uuid=ca4ef7a3-718c-40c0-a2e0-bb636fc2214d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converting VIF {"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:62:d5,bridge_name='br-int',has_traffic_filtering=True,id=1a222150-39b6-4eb8-8502-379bd9f9f468,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a222150-39') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG os_vif [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:62:d5,bridge_name='br-int',has_traffic_filtering=True,id=1a222150-39b6-4eb8-8502-379bd9f9f468,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a222150-39') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a222150-39, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-01153159-0690-4291-9cb4-a1aba7f32d61 req-12c49532-9870-4cf6-a27f-df396005f135 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-changed-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-01153159-0690-4291-9cb4-a1aba7f32d61 req-12c49532-9870-4cf6-a27f-df396005f135 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Refreshing instance network info cache due to event network-changed-1a222150-39b6-4eb8-8502-379bd9f9f468. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-01153159-0690-4291-9cb4-a1aba7f32d61 req-12c49532-9870-4cf6-a27f-df396005f135 service nova] Acquiring lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-01153159-0690-4291-9cb4-a1aba7f32d61 req-12c49532-9870-4cf6-a27f-df396005f135 service nova] Acquired lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG nova.network.neutron [req-01153159-0690-4291-9cb4-a1aba7f32d61 req-12c49532-9870-4cf6-a27f-df396005f135 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Refreshing network info cache for port 1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71e26c5f-a94c-485c-a3a5-78b21aef57b5) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:30:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:51 user nova-compute[75018]: INFO os_vif [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:62:d5,bridge_name='br-int',has_traffic_filtering=True,id=1a222150-39b6-4eb8-8502-379bd9f9f468,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a222150-39')
Nov 07 15:30:51 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Deleting instance files /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d_del
Nov 07 15:30:51 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Deletion of /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d_del complete
Nov 07 15:30:52 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Deleted allocations for instance ca4ef7a3-718c-40c0-a2e0-bb636fc2214d
Nov 07 15:30:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:52 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'numa_topology' on Instance uuid ca4ef7a3-718c-40c0-a2e0-bb636fc2214d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:30:52 user nova-compute[75018]: DEBUG nova.objects.base [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Object Instance<ca4ef7a3-718c-40c0-a2e0-bb636fc2214d> lazy-loaded attributes: resources,numa_topology {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:30:52 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:30:52 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:30:52 user nova-compute[75018]: DEBUG nova.network.neutron [req-01153159-0690-4291-9cb4-a1aba7f32d61 req-12c49532-9870-4cf6-a27f-df396005f135 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Updated VIF entry in instance network info cache for port 1a222150-39b6-4eb8-8502-379bd9f9f468. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:30:52 user nova-compute[75018]: DEBUG nova.network.neutron [req-01153159-0690-4291-9cb4-a1aba7f32d61 req-12c49532-9870-4cf6-a27f-df396005f135 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Updating instance_info_cache with network_info: [{"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1a222150-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:30:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-01153159-0690-4291-9cb4-a1aba7f32d61 req-12c49532-9870-4cf6-a27f-df396005f135 service nova] Releasing lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:30:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a0e855bf-26d8-479d-9420-20b65dc10763 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.877s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "55fb155e-ec0a-4d67-8427-c2158da7003a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lazy-loading 'flavor' on Instance uuid 55fb155e-ec0a-4d67-8427-c2158da7003a {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "55fb155e-ec0a-4d67-8427-c2158da7003a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:30:55 user nova-compute[75018]: INFO nova.compute.manager [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Attaching volume cfbc1c0d-f019-455c-9205-0bf5bc0459c0 to /dev/vdb
Nov 07 15:30:55 user nova-compute[75018]: DEBUG os_brick.utils [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2f7b21-118c-463e-83f4-be9b3a133ef4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[720a2f67-d6b3-4142-97a0-5df0a7adb24e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba483342-f133-4438-90f0-6c855ef19eb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0c2c64-62d8-4c13-af5e-3c4d3f4e90db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:30:55 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:30:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[563b1d00-06f8-47f2-867a-7fe12f272137]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG os_brick.utils [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:30:55 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Updating existing volume attachment record: eada024a-f5dd-4029-85f4-0c6465fac735 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:30:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:04 user nova-compute[75018]: INFO nova.compute.manager [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Detaching volume c0ebb9f2-3225-4802-998e-c3b064c3356f
Nov 07 15:31:04 user nova-compute[75018]: INFO nova.virt.block_device [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Attempting to driver detach volume c0ebb9f2-3225-4802-998e-c3b064c3356f from mountpoint /dev/vdb
Nov 07 15:31:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Attempting to detach device vdb from instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:31:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:31:04 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:31:04 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:31:04 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:31:04 user nova-compute[75018]:   <serial>c0ebb9f2-3225-4802-998e-c3b064c3356f</serial>
Nov 07 15:31:04 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:31:04 user nova-compute[75018]: </disk>
Nov 07 15:31:04 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:31:04 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Successfully detached device vdb from instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e from the persistent domain config.
Nov 07 15:31:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:31:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:31:04 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:31:04 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:31:04 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:31:04 user nova-compute[75018]:   <serial>c0ebb9f2-3225-4802-998e-c3b064c3356f</serial>
Nov 07 15:31:04 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:31:04 user nova-compute[75018]: </disk>
Nov 07 15:31:04 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:31:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:31:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:15 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'flavor' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquired lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'info_cache' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG nova.objects.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Object Instance<af83bfa8-3661-4456-8854-f6c457e149fa> lazy-loaded attributes: flavor,info_cache {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Updating instance_info_cache with network_info: [{"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Releasing lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:31:16 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Instance destroyed successfully.
Nov 07 15:31:16 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'resources' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG nova.objects.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Object Instance<af83bfa8-3661-4456-8854-f6c457e149fa> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-986489796',display_name='tempest-AttachVolumeTestJSON-server-986489796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-986489796',id=16,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0hEy6Pitp5/KtTEnBNkgUOns4w4ZMcmpTxmXDQ4xItuv4tIAT4CtKyRNJPdDjMXKTP3ENKo04CbmAPNdTPLrhWCvD73ElO9TJ8YQaIuoQSR42PL5M7RpYpZUxIXnp/KA==',key_name='tempest-keypair-1896323243',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:26:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='393342d93e71462eba531f173860d59f',ramdisk_id='',reservation_id='r-6g6bfllt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1503001538',owner_user_name='tempest-AttachVolumeTestJSON-1503001538-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8af061ec9b2444ecbbc2d1ef913fe558',uuid=af83bfa8-3661-4456-8854-f6c457e149fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converting VIF {"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_vif [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap305ed47b-06, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f798110b-9d08-4f26-ae4e-5627c3023817) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:31:16 user nova-compute[75018]: INFO os_vif [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06')
Nov 07 15:31:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYhTCRdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:31:16 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[40519df5-1a96-4567-975c-c6ebdd46362c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:31:16 user nova-compute[75018]: No targets found.
Nov 07 15:31:16 user nova-compute[75018]: iSNS:
Nov 07 15:31:16 user nova-compute[75018]: No targets found.
Nov 07 15:31:16 user nova-compute[75018]: STATIC:
Nov 07 15:31:16 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f
Nov 07 15:31:16 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:31:16 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:31:16 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11
Nov 07 15:31:16 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:31:16 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:31:16 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e
Nov 07 15:31:16 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:31:16 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:31:16 user nova-compute[75018]: FIRMWARE:
Nov 07 15:31:16 user nova-compute[75018]: No targets found.
Nov 07 15:31:16 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:31:16 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:31:16 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[896163c5-3fb3-4a32-a14f-d2557c1d5423]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c982b6e-6d96-4fcd-9f33-656485a1942c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:31:16 user nova-compute[75018]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:31:16 user nova-compute[75018]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)
Nov 07 15:31:16 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:31:16 user nova-compute[75018]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:31:16 user nova-compute[75018]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)
Nov 07 15:31:16 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb0016c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11'): ({'sdd'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Removing single pathed devices sdd {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf6f203-933c-458d-809c-9c171493ea0c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[47453e00-ac6c-4304-a2c0-9d2a0b31050e]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Flushing IO for device /dev/sdd {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e08e48a-d69d-4430-bda4-c1b0f12ecd48]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6462b820-1c99-4ef9-88e0-66262fe03198]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec4f987-57bd-42a2-90d7-ef07075fe998]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0015d5-8abf-48a1-8934-4dcd7e63465e]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260]
Nov 07 15:31:17 user nova-compute[75018]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260] successful.
Nov 07 15:31:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[235ffc0d-b219-4e90-b1fc-cabcc610b4d0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] <== disconnect_volume: return (352ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Start _get_guest_xml network_info=[{"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYhTCRdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'af83bfa8-3661-4456-8854-f6c457e149fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac5ae7db-b2b5-451b-aced-4d4b4695ad11', 'serial': 'ac5ae7db-b2b5-451b-aced-4d4b4695ad11'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'e578c8b0-0d85-4559-b02a-ae4eb50bab12', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'numa_topology' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.objects.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Object Instance<af83bfa8-3661-4456-8854-f6c457e149fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:31:17 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:31:17 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'vcpu_model' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.objects.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Object Instance<af83bfa8-3661-4456-8854-f6c457e149fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYhTCRdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:31:17 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:31:17 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:31:17 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f775efa-daee-4c3e-b37d-48d4d832e950]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:31:17 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e03f01-b9e0-464a-9f92-17bc71a06579]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11] added
Nov 07 15:31:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c7533b-ef8a-4fdd-a957-95f902d59cf9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5a2a3c-694e-4d3d-8363-c29dba547d97]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYhTCRdQ {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYhTCRdQ" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9058b3-96a9-4164-8a4d-5c5293740d47]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oYhTCRdQ'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fda3af5-b828-4951-8a88-c281bf192c45]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[783b1fd7-0ad9-401a-88f9-b7f04293e519]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:31:17 user nova-compute[75018]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)
Nov 07 15:31:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:31:17 user nova-compute[75018]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)
Nov 07 15:31:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbd43d1-70b3-401f-995b-e470ce4f1e0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260]
Nov 07 15:31:17 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260] successful.
Nov 07 15:31:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[878fc3e8-30c7-4964-b19c-e9f7f018ad28]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffb861a-029c-4370-aa99-a63e6819cda7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:31:17 user nova-compute[75018]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)
Nov 07 15:31:17 user nova-compute[75018]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:31:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:31:17 user nova-compute[75018]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)
Nov 07 15:31:17 user nova-compute[75018]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:31:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd2f262-5a18-4a52-820e-f7e1cbcaf181]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:31:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYhTCRdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26537343261623338', 'path': '/dev/sdd'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537343261623338', 'path': '/dev/sdd'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-986489796',display_name='tempest-AttachVolumeTestJSON-server-986489796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-986489796',id=16,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0hEy6Pitp5/KtTEnBNkgUOns4w4ZMcmpTxmXDQ4xItuv4tIAT4CtKyRNJPdDjMXKTP3ENKo04CbmAPNdTPLrhWCvD73ElO9TJ8YQaIuoQSR42PL5M7RpYpZUxIXnp/KA==',key_name='tempest-keypair-1896323243',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:26:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='393342d93e71462eba531f173860d59f',ramdisk_id='',reservation_id='r-6g6bfllt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1503001538',owner_user_name='tempest-AttachVolumeTestJSON-1503001538-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8af061ec9b2444ecbbc2d1ef913fe558',uuid=af83bfa8-3661-4456-8854-f6c457e149fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converting VIF {"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'pci_devices' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG nova.objects.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Object Instance<af83bfa8-3661-4456-8854-f6c457e149fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:31:18 user nova-compute[75018]:   <uuid>af83bfa8-3661-4456-8854-f6c457e149fa</uuid>
Nov 07 15:31:18 user nova-compute[75018]:   <name>instance-00000010</name>
Nov 07 15:31:18 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:31:18 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:31:18 user nova-compute[75018]:   <metadata>
Nov 07 15:31:18 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:31:18 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:31:18 user nova-compute[75018]:       <nova:name>tempest-AttachVolumeTestJSON-server-986489796</nova:name>
Nov 07 15:31:18 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:31:17</nova:creationTime>
Nov 07 15:31:18 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:31:18 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:31:18 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:31:18 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:31:18 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:31:18 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:31:18 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:31:18 user nova-compute[75018]:       <nova:owner>
Nov 07 15:31:18 user nova-compute[75018]:         <nova:user uuid="8af061ec9b2444ecbbc2d1ef913fe558">tempest-AttachVolumeTestJSON-1503001538-project-member</nova:user>
Nov 07 15:31:18 user nova-compute[75018]:         <nova:project uuid="393342d93e71462eba531f173860d59f">tempest-AttachVolumeTestJSON-1503001538</nova:project>
Nov 07 15:31:18 user nova-compute[75018]:       </nova:owner>
Nov 07 15:31:18 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:31:18 user nova-compute[75018]:       <nova:ports>
Nov 07 15:31:18 user nova-compute[75018]:         <nova:port uuid="305ed47b-06ed-48aa-9584-70e46a35bded">
Nov 07 15:31:18 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 15:31:18 user nova-compute[75018]:         </nova:port>
Nov 07 15:31:18 user nova-compute[75018]:       </nova:ports>
Nov 07 15:31:18 user nova-compute[75018]:     </nova:instance>
Nov 07 15:31:18 user nova-compute[75018]:   </metadata>
Nov 07 15:31:18 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:31:18 user nova-compute[75018]:     <system>
Nov 07 15:31:18 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:31:18 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:31:18 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:31:18 user nova-compute[75018]:       <entry name="serial">af83bfa8-3661-4456-8854-f6c457e149fa</entry>
Nov 07 15:31:18 user nova-compute[75018]:       <entry name="uuid">af83bfa8-3661-4456-8854-f6c457e149fa</entry>
Nov 07 15:31:18 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:31:18 user nova-compute[75018]:     </system>
Nov 07 15:31:18 user nova-compute[75018]:   </sysinfo>
Nov 07 15:31:18 user nova-compute[75018]:   <os>
Nov 07 15:31:18 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:31:18 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:31:18 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:31:18 user nova-compute[75018]:   </os>
Nov 07 15:31:18 user nova-compute[75018]:   <features>
Nov 07 15:31:18 user nova-compute[75018]:     <acpi/>
Nov 07 15:31:18 user nova-compute[75018]:     <apic/>
Nov 07 15:31:18 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:31:18 user nova-compute[75018]:   </features>
Nov 07 15:31:18 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:31:18 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:31:18 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:31:18 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:31:18 user nova-compute[75018]:   </clock>
Nov 07 15:31:18 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:31:18 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:31:18 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:31:18 user nova-compute[75018]:   </cpu>
Nov 07 15:31:18 user nova-compute[75018]:   <devices>
Nov 07 15:31:18 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:31:18 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:31:18 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk"/>
Nov 07 15:31:18 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:31:18 user nova-compute[75018]:     </disk>
Nov 07 15:31:18 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:31:18 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:31:18 user nova-compute[75018]:       <source dev="/dev/sdd"/>
Nov 07 15:31:18 user nova-compute[75018]:       <target dev="vdb" bus="virtio"/>
Nov 07 15:31:18 user nova-compute[75018]:       <serial>ac5ae7db-b2b5-451b-aced-4d4b4695ad11</serial>
Nov 07 15:31:18 user nova-compute[75018]:     </disk>
Nov 07 15:31:18 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:31:18 user nova-compute[75018]:       <mac address="fa:16:3e:f8:80:43"/>
Nov 07 15:31:18 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:31:18 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:31:18 user nova-compute[75018]:       <target dev="tap305ed47b-06"/>
Nov 07 15:31:18 user nova-compute[75018]:     </interface>
Nov 07 15:31:18 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:31:18 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/console.log" append="off"/>
Nov 07 15:31:18 user nova-compute[75018]:     </serial>
Nov 07 15:31:18 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:31:18 user nova-compute[75018]:     <video>
Nov 07 15:31:18 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:31:18 user nova-compute[75018]:     </video>
Nov 07 15:31:18 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:31:18 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:31:18 user nova-compute[75018]:     </rng>
Nov 07 15:31:18 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:31:18 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:31:18 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:31:18 user nova-compute[75018]:     </memballoon>
Nov 07 15:31:18 user nova-compute[75018]:   </devices>
Nov 07 15:31:18 user nova-compute[75018]: </domain>
Nov 07 15:31:18 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'trusted_certs' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG nova.objects.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Object Instance<af83bfa8-3661-4456-8854-f6c457e149fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:31:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.198s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Cannot resize image /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'migration_context' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG nova.objects.base [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Object Instance<af83bfa8-3661-4456-8854-f6c457e149fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-986489796',display_name='tempest-AttachVolumeTestJSON-server-986489796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-986489796',id=16,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0hEy6Pitp5/KtTEnBNkgUOns4w4ZMcmpTxmXDQ4xItuv4tIAT4CtKyRNJPdDjMXKTP3ENKo04CbmAPNdTPLrhWCvD73ElO9TJ8YQaIuoQSR42PL5M7RpYpZUxIXnp/KA==',key_name='tempest-keypair-1896323243',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:26:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='393342d93e71462eba531f173860d59f',ramdisk_id='',reservation_id='r-6g6bfllt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1503001538',owner_user_name='tempest-AttachVolumeTestJSON-1503001538-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8af061ec9b2444ecbbc2d1ef913fe558',uuid=af83bfa8-3661-4456-8854-f6c457e149fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converting VIF {"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG os_vif [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4643f90b-2904-5517-bad1-583bfdc19724', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap305ed47b-06, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap305ed47b-06, col_values=(('qos', UUID('40dbfc19-37af-45e3-bb99-8dbf4bc25780')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap305ed47b-06, col_values=(('external_ids', {'iface-id': '305ed47b-06ed-48aa-9584-70e46a35bded', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:80:43', 'vm-uuid': 'af83bfa8-3661-4456-8854-f6c457e149fa'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:31:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:19 user nova-compute[75018]: INFO os_vif [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06')
Nov 07 15:31:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhsdtSYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:31:21 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:31:21 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:31:21 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ff0dac-8b98-4ecc-94a4-7e2bc24ef86a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:31:21 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aa6c47-9359-49c5-9a5b-336570e3edcb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0] added
Nov 07 15:31:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3929e41-2172-4a6b-a226-d6ec8508b09f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c0694a-9d39-4217-8b7f-c8154ef95a40]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bhsdtSYX {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bhsdtSYX" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a5f941-9c68-4aae-a471-7d2571e8dffc]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bhsdtSYX'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ce584d-45cf-41e9-b232-99b6a2ccb7c1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG nova.compute.manager [req-2ae4122a-53bf-455a-acf8-8641e91e8abc req-9c398a94-114b-4f97-ba1e-00c12ca851a3 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2ae4122a-53bf-455a-acf8-8641e91e8abc req-9c398a94-114b-4f97-ba1e-00c12ca851a3 service nova] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2ae4122a-53bf-455a-acf8-8641e91e8abc req-9c398a94-114b-4f97-ba1e-00c12ca851a3 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2ae4122a-53bf-455a-acf8-8641e91e8abc req-9c398a94-114b-4f97-ba1e-00c12ca851a3 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG nova.compute.manager [req-2ae4122a-53bf-455a-acf8-8641e91e8abc req-9c398a94-114b-4f97-ba1e-00c12ca851a3 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] No waiting events found dispatching network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:31:21 user nova-compute[75018]: WARNING nova.compute.manager [req-2ae4122a-53bf-455a-acf8-8641e91e8abc req-9c398a94-114b-4f97-ba1e-00c12ca851a3 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received unexpected event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded for instance with vm_state stopped and task_state powering-on.
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[779002fb-ba67-4a9d-87d7-87cc7ff04410]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:31:21 user nova-compute[75018]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)
Nov 07 15:31:21 user nova-compute[75018]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:31:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:31:21 user nova-compute[75018]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)
Nov 07 15:31:21 user nova-compute[75018]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:31:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5393b022-15cb-43ae-acbc-20b64fb1a498]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0, portal: 172.16.0.220,3260]
Nov 07 15:31:21 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0, portal: 172.16.0.220,3260] successful.
Nov 07 15:31:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4295f34f-9f11-46c7-ae50-33ab7f7820a8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c570492-d786-47dd-88e2-08900e116afe]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:31:21 user nova-compute[75018]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)
Nov 07 15:31:21 user nova-compute[75018]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:31:21 user nova-compute[75018]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 (non-flash)
Nov 07 15:31:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:31:21 user nova-compute[75018]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)
Nov 07 15:31:21 user nova-compute[75018]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:31:21 user nova-compute[75018]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 (non-flash)
Nov 07 15:31:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[82809147-e370-45e2-86cb-fcf18ceaa66c]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:22 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:31:22 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 15:31:22 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] There are 0 instances to clean {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 15:31:22 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:31:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhsdtSYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:31:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:31:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23638343534313438', 'path': '/dev/sde'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:31:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638343534313438', 'path': '/dev/sde'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:31:22 user nova-compute[75018]: DEBUG nova.objects.instance [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lazy-loading 'flavor' on Instance uuid 55fb155e-ec0a-4d67-8427-c2158da7003a {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:31:22 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:31:22 user nova-compute[75018]:   <source dev="/dev/sde"/>
Nov 07 15:31:22 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:31:22 user nova-compute[75018]:   <serial>cfbc1c0d-f019-455c-9205-0bf5bc0459c0</serial>
Nov 07 15:31:22 user nova-compute[75018]: </disk>
Nov 07 15:31:22 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:31:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:31:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:31:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] No VIF found with MAC fa:16:3e:31:e2:74, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:31:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:31:23 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Instance rebooted successfully.
Nov 07 15:31:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a68186b1-3ef7-4e5f-9de4-87285d9221eb tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:31:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-169f1fdb-1b75-4999-8c6e-7065346dd33f tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.840s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:23 user nova-compute[75018]: DEBUG nova.compute.manager [req-c8d0503e-f9be-45fc-836d-afdaf0c5db86 req-f0c242b6-dfd2-4a55-a22d-7598b0026535 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:31:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c8d0503e-f9be-45fc-836d-afdaf0c5db86 req-f0c242b6-dfd2-4a55-a22d-7598b0026535 service nova] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c8d0503e-f9be-45fc-836d-afdaf0c5db86 req-f0c242b6-dfd2-4a55-a22d-7598b0026535 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c8d0503e-f9be-45fc-836d-afdaf0c5db86 req-f0c242b6-dfd2-4a55-a22d-7598b0026535 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:23 user nova-compute[75018]: DEBUG nova.compute.manager [req-c8d0503e-f9be-45fc-836d-afdaf0c5db86 req-f0c242b6-dfd2-4a55-a22d-7598b0026535 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] No waiting events found dispatching network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:31:23 user nova-compute[75018]: WARNING nova.compute.manager [req-c8d0503e-f9be-45fc-836d-afdaf0c5db86 req-f0c242b6-dfd2-4a55-a22d-7598b0026535 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received unexpected event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded for instance with vm_state active and task_state None.
Nov 07 15:31:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:24 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:31:24 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:31:25 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e is timed out.
Nov 07 15:31:25 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Successfully detached device vdb from instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e from the live domain config.
Nov 07 15:31:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRHUXQbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:31:25 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4166e21a-6d7d-4a7f-803f-91ab64def6b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:31:25 user nova-compute[75018]: No targets found.
Nov 07 15:31:25 user nova-compute[75018]: iSNS:
Nov 07 15:31:25 user nova-compute[75018]: No targets found.
Nov 07 15:31:25 user nova-compute[75018]: STATIC:
Nov 07 15:31:25 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f
Nov 07 15:31:25 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:31:25 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:31:25 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11
Nov 07 15:31:25 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:31:25 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:31:25 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e
Nov 07 15:31:25 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:31:25 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:31:25 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0
Nov 07 15:31:25 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:31:25 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:31:25 user nova-compute[75018]: FIRMWARE:
Nov 07 15:31:25 user nova-compute[75018]: No targets found.
Nov 07 15:31:25 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:31:25 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:31:25 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.119s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8bf46c-d5c5-4d5b-a4c8-f984543cc028]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a733ec-60b4-4761-81b5-30240b138c0a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:31:25 user nova-compute[75018]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)
Nov 07 15:31:25 user nova-compute[75018]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:31:25 user nova-compute[75018]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 (non-flash)
Nov 07 15:31:25 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f (non-flash)
Nov 07 15:31:25 user nova-compute[75018]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)
Nov 07 15:31:25 user nova-compute[75018]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:31:25 user nova-compute[75018]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 (non-flash)
Nov 07 15:31:25 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae07609d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f'): ({'sdc'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Removing single pathed devices sdc {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9ebb4f-c8fd-423d-8e72-edf5022eb592]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd207422-a0b2-411b-9def-092a35e252cb]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Flushing IO for device /dev/sdc {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b550dc5-168e-4d00-85ff-c8d7f635a1be]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4344723-ec25-4337-8e89-8d23dc202406]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9b8d4d-82a3-441d-9076-c60c8c4bda65]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3c8817-3854-4042-b9f5-5edcf247a6d9]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f, portal: 172.16.0.220,3260]
Nov 07 15:31:25 user nova-compute[75018]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f, portal: 172.16.0.220,3260] successful.
Nov 07 15:31:25 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0ebb9f2-3225-4802-998e-c3b064c3356f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b75681b-2e39-487a-af0b-bef4dd1566fa]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.479s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] <== disconnect_volume: return (481ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "55fb155e-ec0a-4d67-8427-c2158da7003a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:25 user nova-compute[75018]: INFO nova.compute.manager [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Detaching volume cfbc1c0d-f019-455c-9205-0bf5bc0459c0
Nov 07 15:31:25 user nova-compute[75018]: INFO nova.virt.block_device [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Attempting to driver detach volume cfbc1c0d-f019-455c-9205-0bf5bc0459c0 from mountpoint /dev/vdb
Nov 07 15:31:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Attempting to detach device vdb from instance 55fb155e-ec0a-4d67-8427-c2158da7003a from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:31:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:31:26 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:31:26 user nova-compute[75018]:   <source dev="/dev/sde"/>
Nov 07 15:31:26 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:31:26 user nova-compute[75018]:   <serial>cfbc1c0d-f019-455c-9205-0bf5bc0459c0</serial>
Nov 07 15:31:26 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:31:26 user nova-compute[75018]: </disk>
Nov 07 15:31:26 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:31:26 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Successfully detached device vdb from instance 55fb155e-ec0a-4d67-8427-c2158da7003a from the persistent domain config.
Nov 07 15:31:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55fb155e-ec0a-4d67-8427-c2158da7003a from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:31:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:31:26 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:31:26 user nova-compute[75018]:   <source dev="/dev/sde"/>
Nov 07 15:31:26 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:31:26 user nova-compute[75018]:   <serial>cfbc1c0d-f019-455c-9205-0bf5bc0459c0</serial>
Nov 07 15:31:26 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:31:26 user nova-compute[75018]: </disk>
Nov 07 15:31:26 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:31:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55fb155e-ec0a-4d67-8427-c2158da7003a {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:31:26 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:31:26 user nova-compute[75018]: DEBUG nova.objects.instance [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lazy-loading 'flavor' on Instance uuid 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d262b8cd-286a-42ca-8295-51bc962a9f97 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.283s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:28 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:31:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:31:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:31:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 15:31:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:31:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:31:29 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:31:29 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updating instance_info_cache with network_info: [{"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:31:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:31:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:31:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:31:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:31:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75018) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 15:31:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:31:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:31:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:30 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:31:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:31:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:34 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:31:34 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:31:34 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7742MB free_disk=25.090442657470703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:31:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance af83bfa8-3661-4456-8854-f6c457e149fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 55fb155e-ec0a-4d67-8427-c2158da7003a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing inventories for resource provider 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating ProviderTree inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing aggregate associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, aggregates: None {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing trait associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:31:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.942s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:42 user nova-compute[75018]: DEBUG nova.compute.manager [req-88076ff1-6391-4d27-99ca-49de33642606 req-db8aeba0-b6e4-4476-b0d0-d8428aea2a10 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-changed-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:31:42 user nova-compute[75018]: DEBUG nova.compute.manager [req-88076ff1-6391-4d27-99ca-49de33642606 req-db8aeba0-b6e4-4476-b0d0-d8428aea2a10 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Refreshing instance network info cache due to event network-changed-340a2fcc-5b10-40db-90d7-646e5d265735. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:31:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-88076ff1-6391-4d27-99ca-49de33642606 req-db8aeba0-b6e4-4476-b0d0-d8428aea2a10 service nova] Acquiring lock "refresh_cache-ec5ab630-cd90-4514-aa9c-e46efc0bf78a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:31:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-88076ff1-6391-4d27-99ca-49de33642606 req-db8aeba0-b6e4-4476-b0d0-d8428aea2a10 service nova] Acquired lock "refresh_cache-ec5ab630-cd90-4514-aa9c-e46efc0bf78a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:31:42 user nova-compute[75018]: DEBUG nova.network.neutron [req-88076ff1-6391-4d27-99ca-49de33642606 req-db8aeba0-b6e4-4476-b0d0-d8428aea2a10 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Refreshing network info cache for port 340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:31:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:42 user nova-compute[75018]: DEBUG nova.objects.instance [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lazy-loading 'flavor' on Instance uuid ec5ab630-cd90-4514-aa9c-e46efc0bf78a {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:42 user nova-compute[75018]: INFO nova.compute.manager [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Attaching volume 68740783-277d-46d3-8306-02c4be843940 to /dev/vdb
Nov 07 15:31:43 user nova-compute[75018]: DEBUG os_brick.utils [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56a7bc3-4ede-41be-ac22-f4f39354571b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58d3c36-b39c-436b-9b3a-cab59a7d56b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc13eed-b51b-458b-bc1d-c7167e887b32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f48bdba-6189-4340-8491-593c92840d84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:31:43 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23a9fec-674b-4d80-94a3-4e454ea23136]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG os_brick.utils [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Updating existing volume attachment record: e0115080-eec0-449b-9dd1-6bcd534ab2a3 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG nova.network.neutron [req-88076ff1-6391-4d27-99ca-49de33642606 req-db8aeba0-b6e4-4476-b0d0-d8428aea2a10 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Updated VIF entry in instance network info cache for port 340a2fcc-5b10-40db-90d7-646e5d265735. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG nova.network.neutron [req-88076ff1-6391-4d27-99ca-49de33642606 req-db8aeba0-b6e4-4476-b0d0-d8428aea2a10 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Updating instance_info_cache with network_info: [{"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:31:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-88076ff1-6391-4d27-99ca-49de33642606 req-db8aeba0-b6e4-4476-b0d0-d8428aea2a10 service nova] Releasing lock "refresh_cache-ec5ab630-cd90-4514-aa9c-e46efc0bf78a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:31:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "31e90a00-c2df-493c-9b7e-12d3063b877f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG nova.compute.manager [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:31:46 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 55fb155e-ec0a-4d67-8427-c2158da7003a is timed out.
Nov 07 15:31:46 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Successfully detached device vdb from instance 55fb155e-ec0a-4d67-8427-c2158da7003a from the live domain config.
Nov 07 15:31:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhsdtSYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:31:46 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b1b371-205f-4958-9cb3-f1bf22e0a8c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a4ca83-f6c1-425b-9645-6ebb89ec8368\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:31:46 user nova-compute[75018]: No targets found.
Nov 07 15:31:46 user nova-compute[75018]: iSNS:
Nov 07 15:31:46 user nova-compute[75018]: No targets found.
Nov 07 15:31:46 user nova-compute[75018]: STATIC:
Nov 07 15:31:46 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11
Nov 07 15:31:46 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:31:46 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:31:46 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e
Nov 07 15:31:46 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:31:46 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:31:46 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:c4a4ca83-f6c1-425b-9645-6ebb89ec8368
Nov 07 15:31:46 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:31:46 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:31:46 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0
Nov 07 15:31:46 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:31:46 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:31:46 user nova-compute[75018]: FIRMWARE:
Nov 07 15:31:46 user nova-compute[75018]: No targets found.
Nov 07 15:31:46 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:31:46 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:31:46 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[678c753f-833d-44d3-bf95-83fb9868b639]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a4ca83-f6c1-425b-9645-6ebb89ec8368\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:31:46 user nova-compute[75018]: INFO nova.compute.claims [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Claim successful on node user
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dbd817-4fc9-4a50-98d9-ad0b9ac771b5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4ca83-f6c1-425b-9645-6ebb89ec8368 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)
Nov 07 15:31:46 user nova-compute[75018]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:31:46 user nova-compute[75018]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 (non-flash)
Nov 07 15:31:46 user nova-compute[75018]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4ca83-f6c1-425b-9645-6ebb89ec8368 (non-flash)
Nov 07 15:31:46 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:489c5afd-b0b4-48e0-b431-16c140216e9e (non-flash)
Nov 07 15:31:46 user nova-compute[75018]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:31:46 user nova-compute[75018]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 (non-flash)
Nov 07 15:31:46 user nova-compute[75018]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4ca83-f6c1-425b-9645-6ebb89ec8368 (non-flash)
Nov 07 15:31:46 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb0184af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0'): ({'sde'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Removing single pathed devices sde {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eff710-240f-4b77-b717-3072d98d6e01]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2ea2e4-9340-446c-98f4-288b96b06c86]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Flushing IO for device /dev/sde {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da6dfb-88c7-4aad-8b60-d9f6a66bae6d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe13674f-f92f-4038-8721-4fcf17f41850]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] SCSI volumes sde have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[550b676b-a953-49b3-8cea-6f1149446620]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[89499052-02be-4aff-af8c-751c632f7f0e]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0, portal: 172.16.0.220,3260]
Nov 07 15:31:46 user nova-compute[75018]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0, portal: 172.16.0.220,3260] successful.
Nov 07 15:31:46 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1c0d-f019-455c-9205-0bf5bc0459c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f840eb9c-70c0-4276-99bb-5117f735ab60]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] <== disconnect_volume: return (361ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:31:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG nova.network.neutron [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:31:47 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:31:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG nova.policy [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6096aee5520e4cc4a9f34fdef6bae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba46e41b23a4c1b93fa1e8b03715ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:31:47 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Creating image(s)
Nov 07 15:31:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "/opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "/opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "/opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.218s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.183s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk 1073741824" returned: 0 in 0.057s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:48 user nova-compute[75018]: DEBUG nova.objects.instance [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lazy-loading 'flavor' on Instance uuid 55fb155e-ec0a-4d67-8427-c2158da7003a {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-72009702-2a63-41cc-b1d8-2c5a6f921919 tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.249s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.210s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:48 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:31:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:48 user nova-compute[75018]: DEBUG nova.network.neutron [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Successfully created port: c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:31:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:48 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Cannot resize image /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:31:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:31:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Ensure instance console log exists: /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:31:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.network.neutron [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Successfully updated port: c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "refresh_cache-31e90a00-c2df-493c-9b7e-12d3063b877f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquired lock "refresh_cache-31e90a00-c2df-493c-9b7e-12d3063b877f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.network.neutron [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.network.neutron [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-3b294c40-c8bf-48b4-93d8-5236eac0568f req-27e76a6d-f936-483b-a0ce-3211c615e566 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Received event network-changed-c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-3b294c40-c8bf-48b4-93d8-5236eac0568f req-27e76a6d-f936-483b-a0ce-3211c615e566 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Refreshing instance network info cache due to event network-changed-c8446401-eb10-4144-8266-999410a90896. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3b294c40-c8bf-48b4-93d8-5236eac0568f req-27e76a6d-f936-483b-a0ce-3211c615e566 service nova] Acquiring lock "refresh_cache-31e90a00-c2df-493c-9b7e-12d3063b877f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.network.neutron [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Updating instance_info_cache with network_info: [{"id": "c8446401-eb10-4144-8266-999410a90896", "address": "fa:16:3e:d6:25:ef", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8446401-eb", "ovs_interfaceid": "c8446401-eb10-4144-8266-999410a90896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Releasing lock "refresh_cache-31e90a00-c2df-493c-9b7e-12d3063b877f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.compute.manager [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Instance network_info: |[{"id": "c8446401-eb10-4144-8266-999410a90896", "address": "fa:16:3e:d6:25:ef", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8446401-eb", "ovs_interfaceid": "c8446401-eb10-4144-8266-999410a90896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3b294c40-c8bf-48b4-93d8-5236eac0568f req-27e76a6d-f936-483b-a0ce-3211c615e566 service nova] Acquired lock "refresh_cache-31e90a00-c2df-493c-9b7e-12d3063b877f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.network.neutron [req-3b294c40-c8bf-48b4-93d8-5236eac0568f req-27e76a6d-f936-483b-a0ce-3211c615e566 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Refreshing network info cache for port c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Start _get_guest_xml network_info=[{"id": "c8446401-eb10-4144-8266-999410a90896", "address": "fa:16:3e:d6:25:ef", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8446401-eb", "ovs_interfaceid": "c8446401-eb10-4144-8266-999410a90896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:31:49 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:31:49 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:31:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-284257270',display_name='tempest-ServersNegativeTestJSON-server-284257270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-284257270',id=22,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aba46e41b23a4c1b93fa1e8b03715ba8',ramdisk_id='',reservation_id='r-g4jf18ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1403438128',owner_user_name='tempest-ServersNegativeTestJSON-1403438128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:31:47Z,user_data=None,user_id='6096aee5520e4cc4a9f34fdef6bae6da',uuid=31e90a00-c2df-493c-9b7e-12d3063b877f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8446401-eb10-4144-8266-999410a90896", "address": "fa:16:3e:d6:25:ef", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8446401-eb", "ovs_interfaceid": "c8446401-eb10-4144-8266-999410a90896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Converting VIF {"id": "c8446401-eb10-4144-8266-999410a90896", "address": "fa:16:3e:d6:25:ef", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8446401-eb", "ovs_interfaceid": "c8446401-eb10-4144-8266-999410a90896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:25:ef,bridge_name='br-int',has_traffic_filtering=True,id=c8446401-eb10-4144-8266-999410a90896,network=Network(4360a01c-f5c5-4d5f-86f0-0ace428bfe0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8446401-eb') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG nova.objects.instance [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lazy-loading 'pci_devices' on Instance uuid 31e90a00-c2df-493c-9b7e-12d3063b877f {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:31:50 user nova-compute[75018]:   <uuid>31e90a00-c2df-493c-9b7e-12d3063b877f</uuid>
Nov 07 15:31:50 user nova-compute[75018]:   <name>instance-00000016</name>
Nov 07 15:31:50 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:31:50 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:31:50 user nova-compute[75018]:   <metadata>
Nov 07 15:31:50 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:31:50 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:31:50 user nova-compute[75018]:       <nova:name>tempest-ServersNegativeTestJSON-server-284257270</nova:name>
Nov 07 15:31:50 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:31:49</nova:creationTime>
Nov 07 15:31:50 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:31:50 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:31:50 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:31:50 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:31:50 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:31:50 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:31:50 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:31:50 user nova-compute[75018]:       <nova:owner>
Nov 07 15:31:50 user nova-compute[75018]:         <nova:user uuid="6096aee5520e4cc4a9f34fdef6bae6da">tempest-ServersNegativeTestJSON-1403438128-project-member</nova:user>
Nov 07 15:31:50 user nova-compute[75018]:         <nova:project uuid="aba46e41b23a4c1b93fa1e8b03715ba8">tempest-ServersNegativeTestJSON-1403438128</nova:project>
Nov 07 15:31:50 user nova-compute[75018]:       </nova:owner>
Nov 07 15:31:50 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:31:50 user nova-compute[75018]:       <nova:ports>
Nov 07 15:31:50 user nova-compute[75018]:         <nova:port uuid="c8446401-eb10-4144-8266-999410a90896">
Nov 07 15:31:50 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 07 15:31:50 user nova-compute[75018]:         </nova:port>
Nov 07 15:31:50 user nova-compute[75018]:       </nova:ports>
Nov 07 15:31:50 user nova-compute[75018]:     </nova:instance>
Nov 07 15:31:50 user nova-compute[75018]:   </metadata>
Nov 07 15:31:50 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:31:50 user nova-compute[75018]:     <system>
Nov 07 15:31:50 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:31:50 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:31:50 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:31:50 user nova-compute[75018]:       <entry name="serial">31e90a00-c2df-493c-9b7e-12d3063b877f</entry>
Nov 07 15:31:50 user nova-compute[75018]:       <entry name="uuid">31e90a00-c2df-493c-9b7e-12d3063b877f</entry>
Nov 07 15:31:50 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:31:50 user nova-compute[75018]:     </system>
Nov 07 15:31:50 user nova-compute[75018]:   </sysinfo>
Nov 07 15:31:50 user nova-compute[75018]:   <os>
Nov 07 15:31:50 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:31:50 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:31:50 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:31:50 user nova-compute[75018]:   </os>
Nov 07 15:31:50 user nova-compute[75018]:   <features>
Nov 07 15:31:50 user nova-compute[75018]:     <acpi/>
Nov 07 15:31:50 user nova-compute[75018]:     <apic/>
Nov 07 15:31:50 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:31:50 user nova-compute[75018]:   </features>
Nov 07 15:31:50 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:31:50 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:31:50 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:31:50 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:31:50 user nova-compute[75018]:   </clock>
Nov 07 15:31:50 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:31:50 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:31:50 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:31:50 user nova-compute[75018]:   </cpu>
Nov 07 15:31:50 user nova-compute[75018]:   <devices>
Nov 07 15:31:50 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:31:50 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:31:50 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk"/>
Nov 07 15:31:50 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:31:50 user nova-compute[75018]:     </disk>
Nov 07 15:31:50 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:31:50 user nova-compute[75018]:       <mac address="fa:16:3e:d6:25:ef"/>
Nov 07 15:31:50 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:31:50 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:31:50 user nova-compute[75018]:       <target dev="tapc8446401-eb"/>
Nov 07 15:31:50 user nova-compute[75018]:     </interface>
Nov 07 15:31:50 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:31:50 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/console.log" append="off"/>
Nov 07 15:31:50 user nova-compute[75018]:     </serial>
Nov 07 15:31:50 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:31:50 user nova-compute[75018]:     <video>
Nov 07 15:31:50 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:31:50 user nova-compute[75018]:     </video>
Nov 07 15:31:50 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:31:50 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:31:50 user nova-compute[75018]:     </rng>
Nov 07 15:31:50 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:31:50 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:31:50 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:31:50 user nova-compute[75018]:     </memballoon>
Nov 07 15:31:50 user nova-compute[75018]:   </devices>
Nov 07 15:31:50 user nova-compute[75018]: </domain>
Nov 07 15:31:50 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-284257270',display_name='tempest-ServersNegativeTestJSON-server-284257270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-284257270',id=22,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aba46e41b23a4c1b93fa1e8b03715ba8',ramdisk_id='',reservation_id='r-g4jf18ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1403438128',owner_user_name='tempest-ServersNegativeTestJSON-1403438128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:31:47Z,user_data=None,user_id='6096aee5520e4cc4a9f34fdef6bae6da',uuid=31e90a00-c2df-493c-9b7e-12d3063b877f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8446401-eb10-4144-8266-999410a90896", "address": "fa:16:3e:d6:25:ef", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8446401-eb", "ovs_interfaceid": "c8446401-eb10-4144-8266-999410a90896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Converting VIF {"id": "c8446401-eb10-4144-8266-999410a90896", "address": "fa:16:3e:d6:25:ef", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8446401-eb", "ovs_interfaceid": "c8446401-eb10-4144-8266-999410a90896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:25:ef,bridge_name='br-int',has_traffic_filtering=True,id=c8446401-eb10-4144-8266-999410a90896,network=Network(4360a01c-f5c5-4d5f-86f0-0ace428bfe0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8446401-eb') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG os_vif [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:25:ef,bridge_name='br-int',has_traffic_filtering=True,id=c8446401-eb10-4144-8266-999410a90896,network=Network(4360a01c-f5c5-4d5f-86f0-0ace428bfe0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8446401-eb') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b5a5a56-0b10-577b-9f5c-cd940857679c', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8446401-eb, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8446401-eb, col_values=(('qos', UUID('cac80d97-f0fa-4f34-a8d3-7516692608c0')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8446401-eb, col_values=(('external_ids', {'iface-id': 'c8446401-eb10-4144-8266-999410a90896', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:25:ef', 'vm-uuid': '31e90a00-c2df-493c-9b7e-12d3063b877f'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:50 user nova-compute[75018]: INFO os_vif [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:25:ef,bridge_name='br-int',has_traffic_filtering=True,id=c8446401-eb10-4144-8266-999410a90896,network=Network(4360a01c-f5c5-4d5f-86f0-0ace428bfe0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8446401-eb')
Nov 07 15:31:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] No VIF found with MAC fa:16:3e:d6:25:ef, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:31:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:51 user nova-compute[75018]: DEBUG nova.network.neutron [req-3b294c40-c8bf-48b4-93d8-5236eac0568f req-27e76a6d-f936-483b-a0ce-3211c615e566 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Updated VIF entry in instance network info cache for port c8446401-eb10-4144-8266-999410a90896. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:31:51 user nova-compute[75018]: DEBUG nova.network.neutron [req-3b294c40-c8bf-48b4-93d8-5236eac0568f req-27e76a6d-f936-483b-a0ce-3211c615e566 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Updating instance_info_cache with network_info: [{"id": "c8446401-eb10-4144-8266-999410a90896", "address": "fa:16:3e:d6:25:ef", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8446401-eb", "ovs_interfaceid": "c8446401-eb10-4144-8266-999410a90896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:31:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3b294c40-c8bf-48b4-93d8-5236eac0568f req-27e76a6d-f936-483b-a0ce-3211c615e566 service nova] Releasing lock "refresh_cache-31e90a00-c2df-493c-9b7e-12d3063b877f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:31:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-d6afd366-7cbf-4c07-b56f-16d32f59a2f0 req-eb8fff60-24dc-4abc-bdba-610b821cf7f4 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Received event network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:31:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d6afd366-7cbf-4c07-b56f-16d32f59a2f0 req-eb8fff60-24dc-4abc-bdba-610b821cf7f4 service nova] Acquiring lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d6afd366-7cbf-4c07-b56f-16d32f59a2f0 req-eb8fff60-24dc-4abc-bdba-610b821cf7f4 service nova] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d6afd366-7cbf-4c07-b56f-16d32f59a2f0 req-eb8fff60-24dc-4abc-bdba-610b821cf7f4 service nova] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-d6afd366-7cbf-4c07-b56f-16d32f59a2f0 req-eb8fff60-24dc-4abc-bdba-610b821cf7f4 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] No waiting events found dispatching network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:31:52 user nova-compute[75018]: WARNING nova.compute.manager [req-d6afd366-7cbf-4c07-b56f-16d32f59a2f0 req-eb8fff60-24dc-4abc-bdba-610b821cf7f4 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Received unexpected event network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 for instance with vm_state building and task_state spawning.
Nov 07 15:31:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG nova.compute.manager [req-658a6dca-0dd9-4424-a899-fb53f882d5ba req-9049990f-9580-469b-8fad-04f2917d4cea service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Received event network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-658a6dca-0dd9-4424-a899-fb53f882d5ba req-9049990f-9580-469b-8fad-04f2917d4cea service nova] Acquiring lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-658a6dca-0dd9-4424-a899-fb53f882d5ba req-9049990f-9580-469b-8fad-04f2917d4cea service nova] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-658a6dca-0dd9-4424-a899-fb53f882d5ba req-9049990f-9580-469b-8fad-04f2917d4cea service nova] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG nova.compute.manager [req-658a6dca-0dd9-4424-a899-fb53f882d5ba req-9049990f-9580-469b-8fad-04f2917d4cea service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] No waiting events found dispatching network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:31:54 user nova-compute[75018]: WARNING nova.compute.manager [req-658a6dca-0dd9-4424-a899-fb53f882d5ba req-9049990f-9580-469b-8fad-04f2917d4cea service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Received unexpected event network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 for instance with vm_state building and task_state spawning.
Nov 07 15:31:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG nova.compute.manager [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:31:54 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Instance spawned successfully.
Nov 07 15:31:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:31:54 user nova-compute[75018]: INFO nova.compute.claims [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Claim successful on node user
Nov 07 15:31:54 user nova-compute[75018]: INFO nova.compute.manager [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Took 7.17 seconds to spawn the instance on the hypervisor.
Nov 07 15:31:54 user nova-compute[75018]: DEBUG nova.compute.manager [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:31:54 user nova-compute[75018]: INFO nova.compute.manager [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Took 8.23 seconds to build instance.
Nov 07 15:31:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33d697bf-cfbf-4c49-9794-36ce340468cb tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.428s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:31:55 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:31:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG nova.policy [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ecef8d2ab1c490d98e9f65e16241cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d39d9835e04ea393a5c6ef8046aac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:31:55 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Creating image(s)
Nov 07 15:31:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "/opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "/opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:55 user nova-compute[75018]: INFO nova.compute.manager [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Terminating instance
Nov 07 15:31:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.264s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG nova.compute.manager [req-d3acb71b-f7b1-4027-96f1-359bfeb7db14 req-de62878c-4000-410e-957e-3e9750ac01fe service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-vif-unplugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d3acb71b-f7b1-4027-96f1-359bfeb7db14 req-de62878c-4000-410e-957e-3e9750ac01fe service nova] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d3acb71b-f7b1-4027-96f1-359bfeb7db14 req-de62878c-4000-410e-957e-3e9750ac01fe service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d3acb71b-f7b1-4027-96f1-359bfeb7db14 req-de62878c-4000-410e-957e-3e9750ac01fe service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG nova.compute.manager [req-d3acb71b-f7b1-4027-96f1-359bfeb7db14 req-de62878c-4000-410e-957e-3e9750ac01fe service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] No waiting events found dispatching network-vif-unplugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG nova.compute.manager [req-d3acb71b-f7b1-4027-96f1-359bfeb7db14 req-de62878c-4000-410e-957e-3e9750ac01fe service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-vif-unplugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.274s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk 1073741824" returned: 0 in 0.075s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.214s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:56 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Instance destroyed successfully.
Nov 07 15:31:56 user nova-compute[75018]: DEBUG nova.objects.instance [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lazy-loading 'resources' on Instance uuid 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1060099405',display_name='tempest-ServerStableDeviceRescueTest-server-1060099405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1060099405',id=13,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsh3m/AqvutcaB/9qpzjup0szhTy9U7TET9KerVY4YFJ3We6+i+pyTqY/LNekdndGfNoBNA07ivKONj4Ow+ANxrGLLW8+Jt5PgTGpfXG/eJIu8EEpT7vH1p59af4bkJ7w==',key_name='tempest-keypair-1769152991',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:28:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02ee8e1771f54c2487c53dc92ed64f84',ramdisk_id='',reservation_id='r-0fhpeenx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1105529090',owner_user_name='tempest-ServerStableDeviceRescueTest-1105529090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:30:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14513d0fd65548438fa3d8566ef13d0b',uuid=4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Converting VIF {"id": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "address": "fa:16:3e:fd:ca:d8", "network": {"id": "ff9ceebb-2e39-4b05-8df4-ec60615d958d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2029007487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02ee8e1771f54c2487c53dc92ed64f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ce6c8c-ae", "ovs_interfaceid": "97ce6c8c-ae6c-444d-a746-0c41c90dad44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:ca:d8,bridge_name='br-int',has_traffic_filtering=True,id=97ce6c8c-ae6c-444d-a746-0c41c90dad44,network=Network(ff9ceebb-2e39-4b05-8df4-ec60615d958d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ce6c8c-ae') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG os_vif [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:ca:d8,bridge_name='br-int',has_traffic_filtering=True,id=97ce6c8c-ae6c-444d-a746-0c41c90dad44,network=Network(ff9ceebb-2e39-4b05-8df4-ec60615d958d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ce6c8c-ae') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97ce6c8c-ae, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95ccedf3-c0f9-4da3-aea5-26026c99508d) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:56 user nova-compute[75018]: INFO os_vif [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:ca:d8,bridge_name='br-int',has_traffic_filtering=True,id=97ce6c8c-ae6c-444d-a746-0c41c90dad44,network=Network(ff9ceebb-2e39-4b05-8df4-ec60615d958d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ce6c8c-ae')
Nov 07 15:31:56 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Deleting instance files /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e_del
Nov 07 15:31:56 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Deletion of /opt/stack/data/nova/instances/4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e_del complete
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Cannot resize image /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Ensure instance console log exists: /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Successfully created port: ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:31:56 user nova-compute[75018]: INFO nova.compute.manager [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 07 15:31:56 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:31:56 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:31:57 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Successfully updated port: ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:31:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "refresh_cache-2fc7eecf-a7a9-410b-83d4-1cb15542aea2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:31:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquired lock "refresh_cache-2fc7eecf-a7a9-410b-83d4-1cb15542aea2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:31:57 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:31:57 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:31:57 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:31:57 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Took 1.28 seconds to deallocate network for instance.
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-0529a113-040d-43c7-a19a-1f00803bbba4 req-49c5f09c-1150-4087-8251-8668fefed8f1 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-vif-deleted-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-9b359017-444a-4ad4-b892-cd8541594c2a req-6855b5ff-8351-40d0-a125-43397a284433 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b359017-444a-4ad4-b892-cd8541594c2a req-6855b5ff-8351-40d0-a125-43397a284433 service nova] Acquiring lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b359017-444a-4ad4-b892-cd8541594c2a req-6855b5ff-8351-40d0-a125-43397a284433 service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b359017-444a-4ad4-b892-cd8541594c2a req-6855b5ff-8351-40d0-a125-43397a284433 service nova] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-9b359017-444a-4ad4-b892-cd8541594c2a req-6855b5ff-8351-40d0-a125-43397a284433 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] No waiting events found dispatching network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:31:58 user nova-compute[75018]: WARNING nova.compute.manager [req-9b359017-444a-4ad4-b892-cd8541594c2a req-6855b5ff-8351-40d0-a125-43397a284433 service nova] [instance: 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e] Received unexpected event network-vif-plugged-97ce6c8c-ae6c-444d-a746-0c41c90dad44 for instance with vm_state active and task_state deleting.
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-9b359017-444a-4ad4-b892-cd8541594c2a req-6855b5ff-8351-40d0-a125-43397a284433 service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Received event network-changed-ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-9b359017-444a-4ad4-b892-cd8541594c2a req-6855b5ff-8351-40d0-a125-43397a284433 service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Refreshing instance network info cache due to event network-changed-ecda3b03-86ac-4e5f-a1b1-d28806f2512a. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b359017-444a-4ad4-b892-cd8541594c2a req-6855b5ff-8351-40d0-a125-43397a284433 service nova] Acquiring lock "refresh_cache-2fc7eecf-a7a9-410b-83d4-1cb15542aea2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Updating instance_info_cache with network_info: [{"id": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "address": "fa:16:3e:8b:ff:20", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda3b03-86", "ovs_interfaceid": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Releasing lock "refresh_cache-2fc7eecf-a7a9-410b-83d4-1cb15542aea2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Instance network_info: |[{"id": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "address": "fa:16:3e:8b:ff:20", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda3b03-86", "ovs_interfaceid": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b359017-444a-4ad4-b892-cd8541594c2a req-6855b5ff-8351-40d0-a125-43397a284433 service nova] Acquired lock "refresh_cache-2fc7eecf-a7a9-410b-83d4-1cb15542aea2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.network.neutron [req-9b359017-444a-4ad4-b892-cd8541594c2a req-6855b5ff-8351-40d0-a125-43397a284433 service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Refreshing network info cache for port ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Start _get_guest_xml network_info=[{"id": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "address": "fa:16:3e:8b:ff:20", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda3b03-86", "ovs_interfaceid": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:31:58 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:31:58 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:31:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1304160086',display_name='tempest-VolumesSnapshotTestJSON-instance-1304160086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1304160086',id=23,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcgjfh0mRqGNOc19KV88V1Iyf4yPsO8J3ZNs/RIr59vs/rjT5pxmh75R9fvI4e5KCzgOkj8L5IZKNNLUS5h7y1HqgezpBvPjv9EMVUXhDLL7gSlqq1S+/DElIJloYQjkg==',key_name='tempest-keypair-2101687583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d39d9835e04ea393a5c6ef8046aac2',ramdisk_id='',reservation_id='r-g9ph6x1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-666600934',owner_user_name='tempest-VolumesSnapshotTestJSON-666600934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:31:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ecef8d2ab1c490d98e9f65e16241cf1',uuid=2fc7eecf-a7a9-410b-83d4-1cb15542aea2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "address": "fa:16:3e:8b:ff:20", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda3b03-86", "ovs_interfaceid": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Converting VIF {"id": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "address": "fa:16:3e:8b:ff:20", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda3b03-86", "ovs_interfaceid": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=ecda3b03-86ac-4e5f-a1b1-d28806f2512a,network=Network(85503726-f3c9-4bad-958c-d4bade647236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecda3b03-86') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.objects.instance [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:31:58 user nova-compute[75018]:   <uuid>2fc7eecf-a7a9-410b-83d4-1cb15542aea2</uuid>
Nov 07 15:31:58 user nova-compute[75018]:   <name>instance-00000017</name>
Nov 07 15:31:58 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:31:58 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:31:58 user nova-compute[75018]:   <metadata>
Nov 07 15:31:58 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:31:58 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:31:58 user nova-compute[75018]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1304160086</nova:name>
Nov 07 15:31:58 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:31:58</nova:creationTime>
Nov 07 15:31:58 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:31:58 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:31:58 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:31:58 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:31:58 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:31:58 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:31:58 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:31:58 user nova-compute[75018]:       <nova:owner>
Nov 07 15:31:58 user nova-compute[75018]:         <nova:user uuid="5ecef8d2ab1c490d98e9f65e16241cf1">tempest-VolumesSnapshotTestJSON-666600934-project-member</nova:user>
Nov 07 15:31:58 user nova-compute[75018]:         <nova:project uuid="d0d39d9835e04ea393a5c6ef8046aac2">tempest-VolumesSnapshotTestJSON-666600934</nova:project>
Nov 07 15:31:58 user nova-compute[75018]:       </nova:owner>
Nov 07 15:31:58 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:31:58 user nova-compute[75018]:       <nova:ports>
Nov 07 15:31:58 user nova-compute[75018]:         <nova:port uuid="ecda3b03-86ac-4e5f-a1b1-d28806f2512a">
Nov 07 15:31:58 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 15:31:58 user nova-compute[75018]:         </nova:port>
Nov 07 15:31:58 user nova-compute[75018]:       </nova:ports>
Nov 07 15:31:58 user nova-compute[75018]:     </nova:instance>
Nov 07 15:31:58 user nova-compute[75018]:   </metadata>
Nov 07 15:31:58 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:31:58 user nova-compute[75018]:     <system>
Nov 07 15:31:58 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:31:58 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:31:58 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:31:58 user nova-compute[75018]:       <entry name="serial">2fc7eecf-a7a9-410b-83d4-1cb15542aea2</entry>
Nov 07 15:31:58 user nova-compute[75018]:       <entry name="uuid">2fc7eecf-a7a9-410b-83d4-1cb15542aea2</entry>
Nov 07 15:31:58 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:31:58 user nova-compute[75018]:     </system>
Nov 07 15:31:58 user nova-compute[75018]:   </sysinfo>
Nov 07 15:31:58 user nova-compute[75018]:   <os>
Nov 07 15:31:58 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:31:58 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:31:58 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:31:58 user nova-compute[75018]:   </os>
Nov 07 15:31:58 user nova-compute[75018]:   <features>
Nov 07 15:31:58 user nova-compute[75018]:     <acpi/>
Nov 07 15:31:58 user nova-compute[75018]:     <apic/>
Nov 07 15:31:58 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:31:58 user nova-compute[75018]:   </features>
Nov 07 15:31:58 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:31:58 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:31:58 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:31:58 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:31:58 user nova-compute[75018]:   </clock>
Nov 07 15:31:58 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:31:58 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:31:58 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:31:58 user nova-compute[75018]:   </cpu>
Nov 07 15:31:58 user nova-compute[75018]:   <devices>
Nov 07 15:31:58 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:31:58 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:31:58 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk"/>
Nov 07 15:31:58 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:31:58 user nova-compute[75018]:     </disk>
Nov 07 15:31:58 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:31:58 user nova-compute[75018]:       <mac address="fa:16:3e:8b:ff:20"/>
Nov 07 15:31:58 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:31:58 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:31:58 user nova-compute[75018]:       <target dev="tapecda3b03-86"/>
Nov 07 15:31:58 user nova-compute[75018]:     </interface>
Nov 07 15:31:58 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:31:58 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/console.log" append="off"/>
Nov 07 15:31:58 user nova-compute[75018]:     </serial>
Nov 07 15:31:58 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:31:58 user nova-compute[75018]:     <video>
Nov 07 15:31:58 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:31:58 user nova-compute[75018]:     </video>
Nov 07 15:31:58 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:31:58 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:31:58 user nova-compute[75018]:     </rng>
Nov 07 15:31:58 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:31:58 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:31:58 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:31:58 user nova-compute[75018]:     </memballoon>
Nov 07 15:31:58 user nova-compute[75018]:   </devices>
Nov 07 15:31:58 user nova-compute[75018]: </domain>
Nov 07 15:31:58 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:31:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1304160086',display_name='tempest-VolumesSnapshotTestJSON-instance-1304160086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1304160086',id=23,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcgjfh0mRqGNOc19KV88V1Iyf4yPsO8J3ZNs/RIr59vs/rjT5pxmh75R9fvI4e5KCzgOkj8L5IZKNNLUS5h7y1HqgezpBvPjv9EMVUXhDLL7gSlqq1S+/DElIJloYQjkg==',key_name='tempest-keypair-2101687583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d39d9835e04ea393a5c6ef8046aac2',ramdisk_id='',reservation_id='r-g9ph6x1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-666600934',owner_user_name='tempest-VolumesSnapshotTestJSON-666600934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:31:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ecef8d2ab1c490d98e9f65e16241cf1',uuid=2fc7eecf-a7a9-410b-83d4-1cb15542aea2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "address": "fa:16:3e:8b:ff:20", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda3b03-86", "ovs_interfaceid": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Converting VIF {"id": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "address": "fa:16:3e:8b:ff:20", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda3b03-86", "ovs_interfaceid": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=ecda3b03-86ac-4e5f-a1b1-d28806f2512a,network=Network(85503726-f3c9-4bad-958c-d4bade647236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecda3b03-86') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG os_vif [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=ecda3b03-86ac-4e5f-a1b1-d28806f2512a,network=Network(85503726-f3c9-4bad-958c-d4bade647236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecda3b03-86') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd691d67c-6e98-511f-b00d-4cd82439dd09', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecda3b03-86, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecda3b03-86, col_values=(('qos', UUID('46cdb9fe-e064-4dba-af18-fced22a3a90f')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecda3b03-86, col_values=(('external_ids', {'iface-id': 'ecda3b03-86ac-4e5f-a1b1-d28806f2512a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:ff:20', 'vm-uuid': '2fc7eecf-a7a9-410b-83d4-1cb15542aea2'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:31:58 user nova-compute[75018]: INFO os_vif [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=ecda3b03-86ac-4e5f-a1b1-d28806f2512a,network=Network(85503726-f3c9-4bad-958c-d4bade647236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecda3b03-86')
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] No VIF found with MAC fa:16:3e:8b:ff:20, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:31:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.637s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:31:59 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Deleted allocations for instance 4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e
Nov 07 15:31:59 user nova-compute[75018]: DEBUG nova.network.neutron [req-9b359017-444a-4ad4-b892-cd8541594c2a req-6855b5ff-8351-40d0-a125-43397a284433 service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Updated VIF entry in instance network info cache for port ecda3b03-86ac-4e5f-a1b1-d28806f2512a. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:31:59 user nova-compute[75018]: DEBUG nova.network.neutron [req-9b359017-444a-4ad4-b892-cd8541594c2a req-6855b5ff-8351-40d0-a125-43397a284433 service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Updating instance_info_cache with network_info: [{"id": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "address": "fa:16:3e:8b:ff:20", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda3b03-86", "ovs_interfaceid": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:31:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b359017-444a-4ad4-b892-cd8541594c2a req-6855b5ff-8351-40d0-a125-43397a284433 service nova] Releasing lock "refresh_cache-2fc7eecf-a7a9-410b-83d4-1cb15542aea2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:31:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b777032d-5b65-4b73-92e7-72037dc810e6 tempest-ServerStableDeviceRescueTest-1105529090 tempest-ServerStableDeviceRescueTest-1105529090-project-member] Lock "4cbd21e2-f62a-4a13-9bd7-c5f0fd5d267e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.739s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-10df7eb0-d453-42e8-b4df-1df9d7926a1e req-20fb2cec-8277-4147-af97-76964f1e351c service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Received event network-vif-plugged-ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10df7eb0-d453-42e8-b4df-1df9d7926a1e req-20fb2cec-8277-4147-af97-76964f1e351c service nova] Acquiring lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10df7eb0-d453-42e8-b4df-1df9d7926a1e req-20fb2cec-8277-4147-af97-76964f1e351c service nova] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-10df7eb0-d453-42e8-b4df-1df9d7926a1e req-20fb2cec-8277-4147-af97-76964f1e351c service nova] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-10df7eb0-d453-42e8-b4df-1df9d7926a1e req-20fb2cec-8277-4147-af97-76964f1e351c service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] No waiting events found dispatching network-vif-plugged-ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:32:00 user nova-compute[75018]: WARNING nova.compute.manager [req-10df7eb0-d453-42e8-b4df-1df9d7926a1e req-20fb2cec-8277-4147-af97-76964f1e351c service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Received unexpected event network-vif-plugged-ecda3b03-86ac-4e5f-a1b1-d28806f2512a for instance with vm_state building and task_state spawning.
Nov 07 15:32:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-e5dd7829-be34-4d29-ab52-1fe20b50ac5b req-8509836f-fc41-455a-97cf-243a17b8c429 service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Received event network-vif-plugged-ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e5dd7829-be34-4d29-ab52-1fe20b50ac5b req-8509836f-fc41-455a-97cf-243a17b8c429 service nova] Acquiring lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e5dd7829-be34-4d29-ab52-1fe20b50ac5b req-8509836f-fc41-455a-97cf-243a17b8c429 service nova] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e5dd7829-be34-4d29-ab52-1fe20b50ac5b req-8509836f-fc41-455a-97cf-243a17b8c429 service nova] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:03 user nova-compute[75018]: DEBUG nova.compute.manager [req-e5dd7829-be34-4d29-ab52-1fe20b50ac5b req-8509836f-fc41-455a-97cf-243a17b8c429 service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] No waiting events found dispatching network-vif-plugged-ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:32:03 user nova-compute[75018]: WARNING nova.compute.manager [req-e5dd7829-be34-4d29-ab52-1fe20b50ac5b req-8509836f-fc41-455a-97cf-243a17b8c429 service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Received unexpected event network-vif-plugged-ecda3b03-86ac-4e5f-a1b1-d28806f2512a for instance with vm_state building and task_state spawning.
Nov 07 15:32:03 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:32:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:32:03 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Instance spawned successfully.
Nov 07 15:32:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:32:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:32:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:32:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:32:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:32:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:32:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:32:03 user nova-compute[75018]: INFO nova.compute.manager [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Took 7.74 seconds to spawn the instance on the hypervisor.
Nov 07 15:32:03 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:32:03 user nova-compute[75018]: INFO nova.compute.manager [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Took 8.80 seconds to build instance.
Nov 07 15:32:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4821fe3-4fec-421b-8354-4f02aa679e4f tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.955s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:32:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UvVSmDLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:32:11 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:32:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:32:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:32:11 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:32:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:32:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:32:11 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:32:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cb14dd-24ac-49d9-b11e-c463e8e4f9bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:32:11 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:32:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[408b13ca-f603-49e7-8a65-1563ef3c1481]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940] added
Nov 07 15:32:11 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:32:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87ce4c8-a108-4a59-9bd1-da5648a05ac4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd94b54-0eb2-47cc-b160-b05b2d52e95c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UvVSmDLz {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UvVSmDLz" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fef8919-6f18-4375-ac24-94207f71819c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UvVSmDLz'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d662959-3e5b-45c1-9e80-2c16c269681b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d006de62-db1c-4078-a585-4ef4453a1b70]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:32:12 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:32:12 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cf9721-1b8b-48af-9309-9bcfd2abb4bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260]
Nov 07 15:32:12 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260] successful.
Nov 07 15:32:12 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9558aa1-b4bd-4be1-b771-c35d24742a3b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f99e05-d503-4391-be9c-1fb6ec6ba232]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:32:12 user nova-compute[75018]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:32:12 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:32:12 user nova-compute[75018]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:32:12 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e013409-9392-4f16-88de-b485e8bcbcc8]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:32:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UvVSmDLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:32:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:32:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23634313061363666', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:32:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634313061363666', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:32:13 user nova-compute[75018]: DEBUG nova.objects.instance [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lazy-loading 'flavor' on Instance uuid ec5ab630-cd90-4514-aa9c-e46efc0bf78a {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:32:13 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:32:13 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 15:32:13 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:32:13 user nova-compute[75018]:   <serial>68740783-277d-46d3-8306-02c4be843940</serial>
Nov 07 15:32:13 user nova-compute[75018]: </disk>
Nov 07 15:32:13 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:32:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:32:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:32:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] No VIF found with MAC fa:16:3e:0e:3b:23, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:32:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f36396d-48b0-4533-9b58-145a21af6a03 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.166s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:15 user nova-compute[75018]: INFO nova.compute.manager [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Rebuilding instance
Nov 07 15:32:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:32:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-8968ae4c-3a50-4c6d-9095-997896e05cb2 req-dcd213b6-bf23-4003-b6ae-afff3902b71f service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-vif-unplugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8968ae4c-3a50-4c6d-9095-997896e05cb2 req-dcd213b6-bf23-4003-b6ae-afff3902b71f service nova] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8968ae4c-3a50-4c6d-9095-997896e05cb2 req-dcd213b6-bf23-4003-b6ae-afff3902b71f service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8968ae4c-3a50-4c6d-9095-997896e05cb2 req-dcd213b6-bf23-4003-b6ae-afff3902b71f service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-8968ae4c-3a50-4c6d-9095-997896e05cb2 req-dcd213b6-bf23-4003-b6ae-afff3902b71f service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] No waiting events found dispatching network-vif-unplugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:32:16 user nova-compute[75018]: WARNING nova.compute.manager [req-8968ae4c-3a50-4c6d-9095-997896e05cb2 req-dcd213b6-bf23-4003-b6ae-afff3902b71f service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received unexpected event network-vif-unplugged-340a2fcc-5b10-40db-90d7-646e5d265735 for instance with vm_state active and task_state rebuilding.
Nov 07 15:32:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:16 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Instance destroyed successfully.
Nov 07 15:32:16 user nova-compute[75018]: INFO nova.compute.manager [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Detaching volume 68740783-277d-46d3-8306-02c4be843940
Nov 07 15:32:16 user nova-compute[75018]: INFO nova.virt.block_device [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Attempting to driver detach volume 68740783-277d-46d3-8306-02c4be843940 from mountpoint /dev/vdb
Nov 07 15:32:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Attempting to detach device vdb from instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:32:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:32:16 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:32:16 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 15:32:16 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:32:16 user nova-compute[75018]:   <serial>68740783-277d-46d3-8306-02c4be843940</serial>
Nov 07 15:32:16 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:32:16 user nova-compute[75018]: </disk>
Nov 07 15:32:16 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:32:16 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Successfully detached device vdb from instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a from the persistent domain config.
Nov 07 15:32:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:32:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UvVSmDLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:32:16 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 07 15:32:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:32:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:32:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b582fb0-d409-4f4c-83df-aaa897291b7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:32:17 user nova-compute[75018]: No targets found.
Nov 07 15:32:17 user nova-compute[75018]: iSNS:
Nov 07 15:32:17 user nova-compute[75018]: No targets found.
Nov 07 15:32:17 user nova-compute[75018]: STATIC:
Nov 07 15:32:17 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11
Nov 07 15:32:17 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:32:17 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:32:17 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940
Nov 07 15:32:17 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:32:17 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:32:17 user nova-compute[75018]: FIRMWARE:
Nov 07 15:32:17 user nova-compute[75018]: No targets found.
Nov 07 15:32:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:32:17 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:32:17 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f06bba9-dd9f-484e-b658-979f91a4d16b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29563fa-30a8-4a6f-8482-ec8fd65b3543]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:32:17 user nova-compute[75018]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:32:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:32:17 user nova-compute[75018]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:32:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae056d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b170e1f3-bb3b-46dd-839c-99c029107281]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6987028-f7f8-4149-8e8d-1b2ed80a27f6]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f68bcd2-257d-41c4-916a-fa23759d92ea]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f170cc-b96e-4964-9290-4bd4398cf092]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b44a184-c03d-46e4-ba00-a644308e085e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bfe037-113a-4440-9ba8-668180972f29]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260]
Nov 07 15:32:17 user nova-compute[75018]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260] successful.
Nov 07 15:32:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1546fd95-bfc1-428e-9346-f70ed07148a8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] <== disconnect_volume: return (371ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:32:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:32:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-078bf288-b0b4-498e-b781-7a9c34c473bc req-28bd5f09-000c-469c-9406-e998f79362a2 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-078bf288-b0b4-498e-b781-7a9c34c473bc req-28bd5f09-000c-469c-9406-e998f79362a2 service nova] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-078bf288-b0b4-498e-b781-7a9c34c473bc req-28bd5f09-000c-469c-9406-e998f79362a2 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-078bf288-b0b4-498e-b781-7a9c34c473bc req-28bd5f09-000c-469c-9406-e998f79362a2 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-078bf288-b0b4-498e-b781-7a9c34c473bc req-28bd5f09-000c-469c-9406-e998f79362a2 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] No waiting events found dispatching network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:32:18 user nova-compute[75018]: WARNING nova.compute.manager [req-078bf288-b0b4-498e-b781-7a9c34c473bc req-28bd5f09-000c-469c-9406-e998f79362a2 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received unexpected event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 for instance with vm_state active and task_state rebuilding.
Nov 07 15:32:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:23 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Instance destroyed successfully.
Nov 07 15:32:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-517169496',display_name='tempest-ServerActionsTestOtherA-server-73412978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-517169496',id=21,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1ib+IZkBUNZq/XSdHL5Mc3rWOjMKRZFDEv86GX4KYwSkRk0NwDBdXdk6iDYaPUir2kHQPF7s/yHU1b885XgqSAd/BtsiAhqj5T9Mo8OTRLSnj98TUeFLSeVstXTuztMA==',key_name='tempest-keypair-1509984004',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:29:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-wrpoydl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=ec5ab630-cd90-4514-aa9c-e46efc0bf78a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:32:23 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:32:23 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=340a2fcc-5b10-40db-90d7-646e5d265735,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340a2fcc-5b') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:32:23 user nova-compute[75018]: DEBUG os_vif [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=340a2fcc-5b10-40db-90d7-646e5d265735,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340a2fcc-5b') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:32:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap340a2fcc-5b, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:32:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4dcb6e4b-6bb8-45ff-ac45-60cf0983a50f) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:32:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:32:23 user nova-compute[75018]: INFO os_vif [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=340a2fcc-5b10-40db-90d7-646e5d265735,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340a2fcc-5b')
Nov 07 15:32:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:32:23 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UvVSmDLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:32:23 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 07 15:32:23 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f5d619-b732-40f4-9a89-26e7bf4e42c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:32:24 user nova-compute[75018]: No targets found.
Nov 07 15:32:24 user nova-compute[75018]: iSNS:
Nov 07 15:32:24 user nova-compute[75018]: No targets found.
Nov 07 15:32:24 user nova-compute[75018]: STATIC:
Nov 07 15:32:24 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11
Nov 07 15:32:24 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:32:24 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:32:24 user nova-compute[75018]: FIRMWARE:
Nov 07 15:32:24 user nova-compute[75018]: No targets found.
Nov 07 15:32:24 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:32:24 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:32:24 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a235bb-1cc1-411c-a7d9-0df3718b7f5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[58808ef5-7558-44a4-bf84-ec71c413585d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:32:24 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:32:24 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb00382710>, {}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Disconnecting from: [] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.089s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] <== disconnect_volume: return (92ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:32:24 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Deleting instance files /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a_del
Nov 07 15:32:24 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Deletion of /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a_del complete
Nov 07 15:32:24 user nova-compute[75018]: INFO nova.virt.block_device [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Booting with volume 68740783-277d-46d3-8306-02c4be843940 at /dev/vdb
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.utils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[319d8651-f580-455e-a1d9-3f1d1ee231de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[df099923-20ba-4427-b842-c08288c2ab5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed621474-7b99-4c16-85c1-b1305ec01456]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[777237a9-176f-4281-a830-cb3223795fbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:32:24 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:32:24 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac9c5d4-8cd0-4afe-895d-5d4a59547592]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG os_brick.utils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:32:24 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Updating existing volume attachment record: 9bc6b08d-504a-413c-99e3-84514428c74f {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:32:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "fa9e2a83-4f50-446b-a5d0-3caaca251953" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "fa9e2a83-4f50-446b-a5d0-3caaca251953" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:32:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:32:25 user nova-compute[75018]: INFO nova.compute.claims [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Claim successful on node user
Nov 07 15:32:26 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.682s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:32:26 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:32:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG nova.policy [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6258fd6050d241f49713a0a788f79aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f5f1be50a349608f65cc66956cce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:32:26 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Creating image(s)
Nov 07 15:32:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "/opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "/opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.224s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.234s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk 1073741824" returned: 0 in 0.062s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.232s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:27 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:32:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:27 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Successfully created port: 5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:32:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:27 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Cannot resize image /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:32:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:32:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Ensure instance console log exists: /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:32:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Successfully updated port: 5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "refresh_cache-fa9e2a83-4f50-446b-a5d0-3caaca251953" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquired lock "refresh_cache-fa9e2a83-4f50-446b-a5d0-3caaca251953" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-2c8de572-fa11-4dec-804b-fe36b4190df0 req-77e7daef-ca59-402e-9f58-c84c6c9d9f4d service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Received event network-changed-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-2c8de572-fa11-4dec-804b-fe36b4190df0 req-77e7daef-ca59-402e-9f58-c84c6c9d9f4d service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Refreshing instance network info cache due to event network-changed-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2c8de572-fa11-4dec-804b-fe36b4190df0 req-77e7daef-ca59-402e-9f58-c84c6c9d9f4d service nova] Acquiring lock "refresh_cache-fa9e2a83-4f50-446b-a5d0-3caaca251953" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Updating instance_info_cache with network_info: [{"id": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "address": "fa:16:3e:62:82:e6", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6aa7d3-a7", "ovs_interfaceid": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Releasing lock "refresh_cache-fa9e2a83-4f50-446b-a5d0-3caaca251953" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Instance network_info: |[{"id": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "address": "fa:16:3e:62:82:e6", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6aa7d3-a7", "ovs_interfaceid": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2c8de572-fa11-4dec-804b-fe36b4190df0 req-77e7daef-ca59-402e-9f58-c84c6c9d9f4d service nova] Acquired lock "refresh_cache-fa9e2a83-4f50-446b-a5d0-3caaca251953" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.network.neutron [req-2c8de572-fa11-4dec-804b-fe36b4190df0 req-77e7daef-ca59-402e-9f58-c84c6c9d9f4d service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Refreshing network info cache for port 5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Start _get_guest_xml network_info=[{"id": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "address": "fa:16:3e:62:82:e6", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6aa7d3-a7", "ovs_interfaceid": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:32:28 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:32:28 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-820068457',display_name='tempest-VolumesActionsTest-instance-820068457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-820068457',id=24,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4f5f1be50a349608f65cc66956cce7d',ramdisk_id='',reservation_id='r-093ji38a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1647501759',owner_user_name='tempest-VolumesActionsTest-1647501759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:32:26Z,user_data=None,user_id='6258fd6050d241f49713a0a788f79aa0',uuid=fa9e2a83-4f50-446b-a5d0-3caaca251953,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "address": "fa:16:3e:62:82:e6", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6aa7d3-a7", "ovs_interfaceid": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Converting VIF {"id": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "address": "fa:16:3e:62:82:e6", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6aa7d3-a7", "ovs_interfaceid": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=5f6aa7d3-a731-4027-9af1-79cc39b1bdd5,network=Network(9c06cf86-20ca-42bb-b009-18115bbbc97d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6aa7d3-a7') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lazy-loading 'pci_devices' on Instance uuid fa9e2a83-4f50-446b-a5d0-3caaca251953 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:32:28 user nova-compute[75018]:   <uuid>fa9e2a83-4f50-446b-a5d0-3caaca251953</uuid>
Nov 07 15:32:28 user nova-compute[75018]:   <name>instance-00000018</name>
Nov 07 15:32:28 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:32:28 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:32:28 user nova-compute[75018]:   <metadata>
Nov 07 15:32:28 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:32:28 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:32:28 user nova-compute[75018]:       <nova:name>tempest-VolumesActionsTest-instance-820068457</nova:name>
Nov 07 15:32:28 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:32:28</nova:creationTime>
Nov 07 15:32:28 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:32:28 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:32:28 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:32:28 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:32:28 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:32:28 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:32:28 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:32:28 user nova-compute[75018]:       <nova:owner>
Nov 07 15:32:28 user nova-compute[75018]:         <nova:user uuid="6258fd6050d241f49713a0a788f79aa0">tempest-VolumesActionsTest-1647501759-project-member</nova:user>
Nov 07 15:32:28 user nova-compute[75018]:         <nova:project uuid="c4f5f1be50a349608f65cc66956cce7d">tempest-VolumesActionsTest-1647501759</nova:project>
Nov 07 15:32:28 user nova-compute[75018]:       </nova:owner>
Nov 07 15:32:28 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:32:28 user nova-compute[75018]:       <nova:ports>
Nov 07 15:32:28 user nova-compute[75018]:         <nova:port uuid="5f6aa7d3-a731-4027-9af1-79cc39b1bdd5">
Nov 07 15:32:28 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 15:32:28 user nova-compute[75018]:         </nova:port>
Nov 07 15:32:28 user nova-compute[75018]:       </nova:ports>
Nov 07 15:32:28 user nova-compute[75018]:     </nova:instance>
Nov 07 15:32:28 user nova-compute[75018]:   </metadata>
Nov 07 15:32:28 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:32:28 user nova-compute[75018]:     <system>
Nov 07 15:32:28 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:32:28 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:32:28 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:32:28 user nova-compute[75018]:       <entry name="serial">fa9e2a83-4f50-446b-a5d0-3caaca251953</entry>
Nov 07 15:32:28 user nova-compute[75018]:       <entry name="uuid">fa9e2a83-4f50-446b-a5d0-3caaca251953</entry>
Nov 07 15:32:28 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:32:28 user nova-compute[75018]:     </system>
Nov 07 15:32:28 user nova-compute[75018]:   </sysinfo>
Nov 07 15:32:28 user nova-compute[75018]:   <os>
Nov 07 15:32:28 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:32:28 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:32:28 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:32:28 user nova-compute[75018]:   </os>
Nov 07 15:32:28 user nova-compute[75018]:   <features>
Nov 07 15:32:28 user nova-compute[75018]:     <acpi/>
Nov 07 15:32:28 user nova-compute[75018]:     <apic/>
Nov 07 15:32:28 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:32:28 user nova-compute[75018]:   </features>
Nov 07 15:32:28 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:32:28 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:32:28 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:32:28 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:32:28 user nova-compute[75018]:   </clock>
Nov 07 15:32:28 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:32:28 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:32:28 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:32:28 user nova-compute[75018]:   </cpu>
Nov 07 15:32:28 user nova-compute[75018]:   <devices>
Nov 07 15:32:28 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:32:28 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:32:28 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk"/>
Nov 07 15:32:28 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:32:28 user nova-compute[75018]:     </disk>
Nov 07 15:32:28 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:32:28 user nova-compute[75018]:       <mac address="fa:16:3e:62:82:e6"/>
Nov 07 15:32:28 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:32:28 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:32:28 user nova-compute[75018]:       <target dev="tap5f6aa7d3-a7"/>
Nov 07 15:32:28 user nova-compute[75018]:     </interface>
Nov 07 15:32:28 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:32:28 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/console.log" append="off"/>
Nov 07 15:32:28 user nova-compute[75018]:     </serial>
Nov 07 15:32:28 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:32:28 user nova-compute[75018]:     <video>
Nov 07 15:32:28 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:32:28 user nova-compute[75018]:     </video>
Nov 07 15:32:28 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:32:28 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:32:28 user nova-compute[75018]:     </rng>
Nov 07 15:32:28 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:32:28 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:32:28 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:32:28 user nova-compute[75018]:     </memballoon>
Nov 07 15:32:28 user nova-compute[75018]:   </devices>
Nov 07 15:32:28 user nova-compute[75018]: </domain>
Nov 07 15:32:28 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-820068457',display_name='tempest-VolumesActionsTest-instance-820068457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-820068457',id=24,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4f5f1be50a349608f65cc66956cce7d',ramdisk_id='',reservation_id='r-093ji38a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1647501759',owner_user_name='tempest-VolumesActionsTest-1647501759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:32:26Z,user_data=None,user_id='6258fd6050d241f49713a0a788f79aa0',uuid=fa9e2a83-4f50-446b-a5d0-3caaca251953,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "address": "fa:16:3e:62:82:e6", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6aa7d3-a7", "ovs_interfaceid": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Converting VIF {"id": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "address": "fa:16:3e:62:82:e6", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6aa7d3-a7", "ovs_interfaceid": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=5f6aa7d3-a731-4027-9af1-79cc39b1bdd5,network=Network(9c06cf86-20ca-42bb-b009-18115bbbc97d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6aa7d3-a7') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG os_vif [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=5f6aa7d3-a731-4027-9af1-79cc39b1bdd5,network=Network(9c06cf86-20ca-42bb-b009-18115bbbc97d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6aa7d3-a7') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5ad2a60-c646-54ab-89e3-63a18673c77b', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f6aa7d3-a7, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f6aa7d3-a7, col_values=(('qos', UUID('b89388d2-dae6-485f-8423-0709f0f06c5e')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f6aa7d3-a7, col_values=(('external_ids', {'iface-id': '5f6aa7d3-a731-4027-9af1-79cc39b1bdd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:82:e6', 'vm-uuid': 'fa9e2a83-4f50-446b-a5d0-3caaca251953'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:28 user nova-compute[75018]: INFO os_vif [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=5f6aa7d3-a731-4027-9af1-79cc39b1bdd5,network=Network(9c06cf86-20ca-42bb-b009-18115bbbc97d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6aa7d3-a7')
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:32:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] No VIF found with MAC fa:16:3e:62:82:e6, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:32:29 user nova-compute[75018]: DEBUG nova.network.neutron [req-2c8de572-fa11-4dec-804b-fe36b4190df0 req-77e7daef-ca59-402e-9f58-c84c6c9d9f4d service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Updated VIF entry in instance network info cache for port 5f6aa7d3-a731-4027-9af1-79cc39b1bdd5. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:32:29 user nova-compute[75018]: DEBUG nova.network.neutron [req-2c8de572-fa11-4dec-804b-fe36b4190df0 req-77e7daef-ca59-402e-9f58-c84c6c9d9f4d service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Updating instance_info_cache with network_info: [{"id": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "address": "fa:16:3e:62:82:e6", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6aa7d3-a7", "ovs_interfaceid": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:32:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2c8de572-fa11-4dec-804b-fe36b4190df0 req-77e7daef-ca59-402e-9f58-c84c6c9d9f4d service nova] Releasing lock "refresh_cache-fa9e2a83-4f50-446b-a5d0-3caaca251953" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-2faea910-c38e-43af-af7c-41718e76ddcc req-93439d5b-9ba0-42c2-a5c4-12d0b288ede1 service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Received event network-vif-plugged-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2faea910-c38e-43af-af7c-41718e76ddcc req-93439d5b-9ba0-42c2-a5c4-12d0b288ede1 service nova] Acquiring lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2faea910-c38e-43af-af7c-41718e76ddcc req-93439d5b-9ba0-42c2-a5c4-12d0b288ede1 service nova] Lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2faea910-c38e-43af-af7c-41718e76ddcc req-93439d5b-9ba0-42c2-a5c4-12d0b288ede1 service nova] Lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-2faea910-c38e-43af-af7c-41718e76ddcc req-93439d5b-9ba0-42c2-a5c4-12d0b288ede1 service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] No waiting events found dispatching network-vif-plugged-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:32:30 user nova-compute[75018]: WARNING nova.compute.manager [req-2faea910-c38e-43af-af7c-41718e76ddcc req-93439d5b-9ba0-42c2-a5c4-12d0b288ede1 service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Received unexpected event network-vif-plugged-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 for instance with vm_state building and task_state spawning.
Nov 07 15:32:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "55fb155e-ec0a-4d67-8427-c2158da7003a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:30 user nova-compute[75018]: INFO nova.compute.manager [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Terminating instance
Nov 07 15:32:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:32:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG nova.compute.manager [req-fb0c8008-020f-4b32-b574-61ad2f31dbc9 req-f657ef8f-0995-4015-a7ca-2a1371bf010d service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Received event network-vif-unplugged-62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fb0c8008-020f-4b32-b574-61ad2f31dbc9 req-f657ef8f-0995-4015-a7ca-2a1371bf010d service nova] Acquiring lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fb0c8008-020f-4b32-b574-61ad2f31dbc9 req-f657ef8f-0995-4015-a7ca-2a1371bf010d service nova] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fb0c8008-020f-4b32-b574-61ad2f31dbc9 req-f657ef8f-0995-4015-a7ca-2a1371bf010d service nova] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG nova.compute.manager [req-fb0c8008-020f-4b32-b574-61ad2f31dbc9 req-f657ef8f-0995-4015-a7ca-2a1371bf010d service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] No waiting events found dispatching network-vif-unplugged-62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG nova.compute.manager [req-fb0c8008-020f-4b32-b574-61ad2f31dbc9 req-f657ef8f-0995-4015-a7ca-2a1371bf010d service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Received event network-vif-unplugged-62ebf755-0030-4d56-bf5d-bbd25c14c1ef for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:32:31 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Instance destroyed successfully.
Nov 07 15:32:31 user nova-compute[75018]: DEBUG nova.objects.instance [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lazy-loading 'resources' on Instance uuid 55fb155e-ec0a-4d67-8427-c2158da7003a {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1598711660',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1598711660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1598711',id=20,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpvvG9zuGjDx4CbNrYf5WmVhEQPI6BfySkCbfR1pCWsGE5J/HwJA3LlJu9OZFEFawIqVG+t2Rnj2NQWuY313NpRQQC+vRzsyfNXZuLpTfoDwyV7Dc3YrgjAF5kffy0IMg==',key_name='tempest-keypair-1643263547',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:29:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcb8653b534c4619abf6bc1d943bd534',ramdisk_id='',reservation_id='r-qo8we1xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-189216407',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:29:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d80017cc8cf244dcb253874281d73f13',uuid=55fb155e-ec0a-4d67-8427-c2158da7003a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "address": "fa:16:3e:31:e2:74", "network": {"id": "4d4dfcec-fc10-48d8-88aa-a55b766a3bd3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-591672914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb8653b534c4619abf6bc1d943bd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ebf755-00", "ovs_interfaceid": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Converting VIF {"id": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "address": "fa:16:3e:31:e2:74", "network": {"id": "4d4dfcec-fc10-48d8-88aa-a55b766a3bd3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-591672914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb8653b534c4619abf6bc1d943bd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ebf755-00", "ovs_interfaceid": "62ebf755-0030-4d56-bf5d-bbd25c14c1ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:e2:74,bridge_name='br-int',has_traffic_filtering=True,id=62ebf755-0030-4d56-bf5d-bbd25c14c1ef,network=Network(4d4dfcec-fc10-48d8-88aa-a55b766a3bd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62ebf755-00') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG os_vif [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:e2:74,bridge_name='br-int',has_traffic_filtering=True,id=62ebf755-0030-4d56-bf5d-bbd25c14c1ef,network=Network(4d4dfcec-fc10-48d8-88aa-a55b766a3bd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62ebf755-00') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62ebf755-00, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a66a64f-2259-4aba-aa5e-1774a01f3162) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:31 user nova-compute[75018]: INFO os_vif [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:e2:74,bridge_name='br-int',has_traffic_filtering=True,id=62ebf755-0030-4d56-bf5d-bbd25c14c1ef,network=Network(4d4dfcec-fc10-48d8-88aa-a55b766a3bd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62ebf755-00')
Nov 07 15:32:31 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Deleting instance files /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a_del
Nov 07 15:32:31 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Deletion of /opt/stack/data/nova/instances/55fb155e-ec0a-4d67-8427-c2158da7003a_del complete
Nov 07 15:32:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:32:31 user nova-compute[75018]: INFO nova.compute.manager [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 07 15:32:31 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:32:31 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updating instance_info_cache with network_info: [{"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:32:32 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Took 0.77 seconds to deallocate network for instance.
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-a409b0e0-d9fb-4eaa-b74f-cd472c9847a5 req-800b31d1-cd98-4624-b06d-1e36dfce0d24 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Received event network-vif-deleted-62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:32 user nova-compute[75018]: INFO nova.compute.manager [req-a409b0e0-d9fb-4eaa-b74f-cd472c9847a5 req-800b31d1-cd98-4624-b06d-1e36dfce0d24 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Neutron deleted interface 62ebf755-0030-4d56-bf5d-bbd25c14c1ef; detaching it from the instance and deleting it from the info cache
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-a409b0e0-d9fb-4eaa-b74f-cd472c9847a5 req-800b31d1-cd98-4624-b06d-1e36dfce0d24 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-a409b0e0-d9fb-4eaa-b74f-cd472c9847a5 req-800b31d1-cd98-4624-b06d-1e36dfce0d24 service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Detach interface failed, port_id=62ebf755-0030-4d56-bf5d-bbd25c14c1ef, reason: Instance 55fb155e-ec0a-4d67-8427-c2158da7003a could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-44743c07-5e8f-46bb-baa3-0c6e2e46cd91 req-6e3fea9b-11fa-49a7-8392-77bc13964b65 service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Received event network-vif-plugged-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-44743c07-5e8f-46bb-baa3-0c6e2e46cd91 req-6e3fea9b-11fa-49a7-8392-77bc13964b65 service nova] Acquiring lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-44743c07-5e8f-46bb-baa3-0c6e2e46cd91 req-6e3fea9b-11fa-49a7-8392-77bc13964b65 service nova] Lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-44743c07-5e8f-46bb-baa3-0c6e2e46cd91 req-6e3fea9b-11fa-49a7-8392-77bc13964b65 service nova] Lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-44743c07-5e8f-46bb-baa3-0c6e2e46cd91 req-6e3fea9b-11fa-49a7-8392-77bc13964b65 service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] No waiting events found dispatching network-vif-plugged-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:32:32 user nova-compute[75018]: WARNING nova.compute.manager [req-44743c07-5e8f-46bb-baa3-0c6e2e46cd91 req-6e3fea9b-11fa-49a7-8392-77bc13964b65 service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Received unexpected event network-vif-plugged-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 for instance with vm_state building and task_state spawning.
Nov 07 15:32:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:32:32 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Instance spawned successfully.
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:32:32 user nova-compute[75018]: INFO nova.compute.manager [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Took 6.44 seconds to spawn the instance on the hypervisor.
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:32:32 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:32:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.364s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:33 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:32:33 user nova-compute[75018]: INFO nova.compute.manager [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Took 7.55 seconds to build instance.
Nov 07 15:32:33 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Deleted allocations for instance 55fb155e-ec0a-4d67-8427-c2158da7003a
Nov 07 15:32:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-07867b70-5443-4023-8057-723bf08bff7b req-a5b15c4a-be0b-4d0a-87e9-45a86837300b service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Received event network-vif-plugged-62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-07867b70-5443-4023-8057-723bf08bff7b req-a5b15c4a-be0b-4d0a-87e9-45a86837300b service nova] Acquiring lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-07867b70-5443-4023-8057-723bf08bff7b req-a5b15c4a-be0b-4d0a-87e9-45a86837300b service nova] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-07867b70-5443-4023-8057-723bf08bff7b req-a5b15c4a-be0b-4d0a-87e9-45a86837300b service nova] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-07867b70-5443-4023-8057-723bf08bff7b req-a5b15c4a-be0b-4d0a-87e9-45a86837300b service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] No waiting events found dispatching network-vif-plugged-62ebf755-0030-4d56-bf5d-bbd25c14c1ef {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:32:33 user nova-compute[75018]: WARNING nova.compute.manager [req-07867b70-5443-4023-8057-723bf08bff7b req-a5b15c4a-be0b-4d0a-87e9-45a86837300b service nova] [instance: 55fb155e-ec0a-4d67-8427-c2158da7003a] Received unexpected event network-vif-plugged-62ebf755-0030-4d56-bf5d-bbd25c14c1ef for instance with vm_state deleted and task_state None.
Nov 07 15:32:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad02f475-2e78-4754-8652-083ecab6fd25 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "fa9e2a83-4f50-446b-a5d0-3caaca251953" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.802s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-457b09ce-30fa-4b56-b01f-9f83c93033ea tempest-TestServerVolumeAttachScenarioOldVersion-189216407 tempest-TestServerVolumeAttachScenarioOldVersion-189216407-project-member] Lock "55fb155e-ec0a-4d67-8427-c2158da7003a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.661s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:32:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:37 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:32:37 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:32:37 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7667MB free_disk=25.198226928710938GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance af83bfa8-3661-4456-8854-f6c457e149fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 31e90a00-c2df-493c-9b7e-12d3063b877f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa9e2a83-4f50-446b-a5d0-3caaca251953 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:37 user nova-compute[75018]: INFO nova.compute.manager [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Unshelving
Nov 07 15:32:38 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:32:38 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:32:38 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:32:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:38 user nova-compute[75018]: DEBUG nova.objects.instance [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'pci_requests' on Instance uuid ca4ef7a3-718c-40c0-a2e0-bb636fc2214d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:38 user nova-compute[75018]: DEBUG nova.objects.instance [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'numa_topology' on Instance uuid ca4ef7a3-718c-40c0-a2e0-bb636fc2214d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:38 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:32:38 user nova-compute[75018]: INFO nova.compute.claims [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Claim successful on node user
Nov 07 15:32:38 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:32:38 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:32:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:38 user nova-compute[75018]: INFO nova.network.neutron [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Updating port 1a222150-39b6-4eb8-8502-379bd9f9f468 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 07 15:32:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:32:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquired lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:32:39 user nova-compute[75018]: DEBUG nova.network.neutron [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:32:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-2a391510-672c-4c3a-9dd7-52a1ce9f3dbc req-2c778405-bf86-4998-807a-2892776d5ca7 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-changed-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-2a391510-672c-4c3a-9dd7-52a1ce9f3dbc req-2c778405-bf86-4998-807a-2892776d5ca7 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Refreshing instance network info cache due to event network-changed-1a222150-39b6-4eb8-8502-379bd9f9f468. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:32:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2a391510-672c-4c3a-9dd7-52a1ce9f3dbc req-2c778405-bf86-4998-807a-2892776d5ca7 service nova] Acquiring lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:32:40 user nova-compute[75018]: DEBUG nova.network.neutron [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Updating instance_info_cache with network_info: [{"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:32:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Releasing lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:32:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:32:40 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Creating image(s)
Nov 07 15:32:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "/opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "/opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:40 user nova-compute[75018]: DEBUG nova.objects.instance [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'trusted_certs' on Instance uuid ca4ef7a3-718c-40c0-a2e0-bb636fc2214d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2a391510-672c-4c3a-9dd7-52a1ce9f3dbc req-2c778405-bf86-4998-807a-2892776d5ca7 service nova] Acquired lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:32:40 user nova-compute[75018]: DEBUG nova.network.neutron [req-2a391510-672c-4c3a-9dd7-52a1ce9f3dbc req-2c778405-bf86-4998-807a-2892776d5ca7 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Refreshing network info cache for port 1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:32:40 user nova-compute[75018]: DEBUG nova.objects.base [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Object Instance<ca4ef7a3-718c-40c0-a2e0-bb636fc2214d> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:32:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "39df42a66cbdf988ea5b498650b17b4d94d8af21" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "39df42a66cbdf988ea5b498650b17b4d94d8af21" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21.part --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:41 user nova-compute[75018]: INFO nova.compute.manager [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Rescuing
Nov 07 15:32:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:32:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquired lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:32:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:32:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21.part --force-share --output=json" returned: 0 in 0.208s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:41 user nova-compute[75018]: DEBUG nova.virt.images [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] b35d981f-bfc5-444c-bd06-372690a5e8f6 was qcow2, converting to raw {{(pid=75018) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 15:32:41 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:32:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21.part /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21.converted {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:32:41 user nova-compute[75018]: DEBUG nova.network.neutron [req-2a391510-672c-4c3a-9dd7-52a1ce9f3dbc req-2c778405-bf86-4998-807a-2892776d5ca7 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Updated VIF entry in instance network info cache for port 1a222150-39b6-4eb8-8502-379bd9f9f468. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:32:41 user nova-compute[75018]: DEBUG nova.network.neutron [req-2a391510-672c-4c3a-9dd7-52a1ce9f3dbc req-2c778405-bf86-4998-807a-2892776d5ca7 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Updating instance_info_cache with network_info: [{"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:32:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2a391510-672c-4c3a-9dd7-52a1ce9f3dbc req-2c778405-bf86-4998-807a-2892776d5ca7 service nova] Releasing lock "refresh_cache-ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG nova.network.neutron [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Updating instance_info_cache with network_info: [{"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Releasing lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21.part /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21.converted" returned: 0 in 0.622s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21.converted --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21.converted --force-share --output=json" returned: 0 in 0.218s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "39df42a66cbdf988ea5b498650b17b4d94d8af21" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.239s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG nova.compute.manager [req-8483ae05-f649-42e6-bfac-847d03c69786 req-828c52bc-5269-4857-9d79-85c1ae3e22c1 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-vif-unplugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8483ae05-f649-42e6-bfac-847d03c69786 req-828c52bc-5269-4857-9d79-85c1ae3e22c1 service nova] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8483ae05-f649-42e6-bfac-847d03c69786 req-828c52bc-5269-4857-9d79-85c1ae3e22c1 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8483ae05-f649-42e6-bfac-847d03c69786 req-828c52bc-5269-4857-9d79-85c1ae3e22c1 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG nova.compute.manager [req-8483ae05-f649-42e6-bfac-847d03c69786 req-828c52bc-5269-4857-9d79-85c1ae3e22c1 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] No waiting events found dispatching network-vif-unplugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:32:42 user nova-compute[75018]: WARNING nova.compute.manager [req-8483ae05-f649-42e6-bfac-847d03c69786 req-828c52bc-5269-4857-9d79-85c1ae3e22c1 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received unexpected event network-vif-unplugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 for instance with vm_state active and task_state rescuing.
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21 --force-share --output=json" returned: 0 in 0.190s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "39df42a66cbdf988ea5b498650b17b4d94d8af21" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "39df42a66cbdf988ea5b498650b17b4d94d8af21" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21 --force-share --output=json" returned: 0 in 0.232s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21,backing_fmt=raw /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:42 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Instance destroyed successfully.
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21,backing_fmt=raw /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk 1073741824" returned: 0 in 0.056s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "39df42a66cbdf988ea5b498650b17b4d94d8af21" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:42 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Attempting rescue
Nov 07 15:32:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75018) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Instance directory exists: not creating {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 15:32:43 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Creating image(s)
Nov 07 15:32:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "/opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "/opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "/opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.objects.instance [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'trusted_certs' on Instance uuid 626a4817-31f4-48c8-9ab6-07d539dd0a14 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21 --force-share --output=json" returned: 0 in 0.223s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.objects.instance [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'migration_context' on Instance uuid ca4ef7a3-718c-40c0-a2e0-bb636fc2214d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.objects.base [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Object Instance<ca4ef7a3-718c-40c0-a2e0-bb636fc2214d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:32:43 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Rebasing disk image.
Nov 07 15:32:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.260s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk.rescue {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk.rescue" returned: 0 in 0.055s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.objects.instance [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'migration_context' on Instance uuid 626a4817-31f4-48c8-9ab6-07d539dd0a14 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.objects.base [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<626a4817-31f4-48c8-9ab6-07d539dd0a14> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Start _get_guest_xml network_info=[{"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "vif_mac": "fa:16:3e:30:3d:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '667dc137-8627-496e-9a1f-9f5738befeda', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.objects.instance [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'resources' on Instance uuid 626a4817-31f4-48c8-9ab6-07d539dd0a14 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.objects.base [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<626a4817-31f4-48c8-9ab6-07d539dd0a14> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.objects.instance [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'numa_topology' on Instance uuid 626a4817-31f4-48c8-9ab6-07d539dd0a14 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.objects.base [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<626a4817-31f4-48c8-9ab6-07d539dd0a14> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:32:43 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:32:43 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:32:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.235s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e -F raw /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.objects.instance [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'vcpu_model' on Instance uuid 626a4817-31f4-48c8-9ab6-07d539dd0a14 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.objects.base [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<626a4817-31f4-48c8-9ab6-07d539dd0a14> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1631876833',display_name='tempest-ServerRescueNegativeTestJSON-server-1631876833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1631876833',id=17,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:28:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374a202b7d114f009ac374762e08c364',ramdisk_id='',reservation_id='r-mh5926va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1476352427',owner_user_name='tempest-ServerRescueNegativeTestJSON-1476352427-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:28:02Z,user_data=None,user_id='869a94fcb52246d583be8bac4a722a3c',uuid=626a4817-31f4-48c8-9ab6-07d539dd0a14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "vif_mac": "fa:16:3e:30:3d:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converting VIF {"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "vif_mac": "fa:16:3e:30:3d:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=f57442b9-562b-4914-80b9-7bc2bf8c8684,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57442b9-56') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.objects.instance [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'pci_devices' on Instance uuid 626a4817-31f4-48c8-9ab6-07d539dd0a14 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.objects.base [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<626a4817-31f4-48c8-9ab6-07d539dd0a14> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:32:43 user nova-compute[75018]:   <uuid>626a4817-31f4-48c8-9ab6-07d539dd0a14</uuid>
Nov 07 15:32:43 user nova-compute[75018]:   <name>instance-00000011</name>
Nov 07 15:32:43 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:32:43 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:32:43 user nova-compute[75018]:   <metadata>
Nov 07 15:32:43 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:32:43 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:32:43 user nova-compute[75018]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1631876833</nova:name>
Nov 07 15:32:43 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:32:43</nova:creationTime>
Nov 07 15:32:43 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:32:43 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:32:43 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:32:43 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:32:43 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:32:43 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:32:43 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:32:43 user nova-compute[75018]:       <nova:owner>
Nov 07 15:32:43 user nova-compute[75018]:         <nova:user uuid="869a94fcb52246d583be8bac4a722a3c">tempest-ServerRescueNegativeTestJSON-1476352427-project-member</nova:user>
Nov 07 15:32:43 user nova-compute[75018]:         <nova:project uuid="374a202b7d114f009ac374762e08c364">tempest-ServerRescueNegativeTestJSON-1476352427</nova:project>
Nov 07 15:32:43 user nova-compute[75018]:       </nova:owner>
Nov 07 15:32:43 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:32:43 user nova-compute[75018]:       <nova:ports>
Nov 07 15:32:43 user nova-compute[75018]:         <nova:port uuid="f57442b9-562b-4914-80b9-7bc2bf8c8684">
Nov 07 15:32:43 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 15:32:43 user nova-compute[75018]:         </nova:port>
Nov 07 15:32:43 user nova-compute[75018]:       </nova:ports>
Nov 07 15:32:43 user nova-compute[75018]:     </nova:instance>
Nov 07 15:32:43 user nova-compute[75018]:   </metadata>
Nov 07 15:32:43 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:32:43 user nova-compute[75018]:     <system>
Nov 07 15:32:43 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:32:43 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:32:43 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:32:43 user nova-compute[75018]:       <entry name="serial">626a4817-31f4-48c8-9ab6-07d539dd0a14</entry>
Nov 07 15:32:43 user nova-compute[75018]:       <entry name="uuid">626a4817-31f4-48c8-9ab6-07d539dd0a14</entry>
Nov 07 15:32:43 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:32:43 user nova-compute[75018]:     </system>
Nov 07 15:32:43 user nova-compute[75018]:   </sysinfo>
Nov 07 15:32:43 user nova-compute[75018]:   <os>
Nov 07 15:32:43 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:32:43 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:32:43 user nova-compute[75018]:   </os>
Nov 07 15:32:43 user nova-compute[75018]:   <features>
Nov 07 15:32:43 user nova-compute[75018]:     <acpi/>
Nov 07 15:32:43 user nova-compute[75018]:     <apic/>
Nov 07 15:32:43 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:32:43 user nova-compute[75018]:   </features>
Nov 07 15:32:43 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:32:43 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:32:43 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:32:43 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:32:43 user nova-compute[75018]:   </clock>
Nov 07 15:32:43 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:32:43 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:32:43 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:32:43 user nova-compute[75018]:   </cpu>
Nov 07 15:32:43 user nova-compute[75018]:   <devices>
Nov 07 15:32:43 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:32:43 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:32:43 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk.rescue"/>
Nov 07 15:32:43 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:32:43 user nova-compute[75018]:     </disk>
Nov 07 15:32:43 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:32:43 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:32:43 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk"/>
Nov 07 15:32:43 user nova-compute[75018]:       <target dev="vdb" bus="virtio"/>
Nov 07 15:32:43 user nova-compute[75018]:     </disk>
Nov 07 15:32:43 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:32:43 user nova-compute[75018]:       <mac address="fa:16:3e:30:3d:00"/>
Nov 07 15:32:43 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:32:43 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:32:43 user nova-compute[75018]:       <target dev="tapf57442b9-56"/>
Nov 07 15:32:43 user nova-compute[75018]:     </interface>
Nov 07 15:32:43 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:32:43 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/console.log" append="off"/>
Nov 07 15:32:43 user nova-compute[75018]:     </serial>
Nov 07 15:32:43 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:32:43 user nova-compute[75018]:     <video>
Nov 07 15:32:43 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:32:43 user nova-compute[75018]:     </video>
Nov 07 15:32:43 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:32:43 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:32:43 user nova-compute[75018]:     </rng>
Nov 07 15:32:43 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:32:43 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:32:43 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:32:43 user nova-compute[75018]:     </memballoon>
Nov 07 15:32:43 user nova-compute[75018]:   </devices>
Nov 07 15:32:43 user nova-compute[75018]: </domain>
Nov 07 15:32:43 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:32:43 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Instance destroyed successfully.
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:32:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No VIF found with MAC fa:16:3e:30:3d:00, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:32:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-adead9a9-0b60-4d64-80ba-f133dcd209b6 req-5be98295-6c16-4cd1-ba6b-ae3838b41b33 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-adead9a9-0b60-4d64-80ba-f133dcd209b6 req-5be98295-6c16-4cd1-ba6b-ae3838b41b33 service nova] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-adead9a9-0b60-4d64-80ba-f133dcd209b6 req-5be98295-6c16-4cd1-ba6b-ae3838b41b33 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-adead9a9-0b60-4d64-80ba-f133dcd209b6 req-5be98295-6c16-4cd1-ba6b-ae3838b41b33 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-adead9a9-0b60-4d64-80ba-f133dcd209b6 req-5be98295-6c16-4cd1-ba6b-ae3838b41b33 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] No waiting events found dispatching network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:32:44 user nova-compute[75018]: WARNING nova.compute.manager [req-adead9a9-0b60-4d64-80ba-f133dcd209b6 req-5be98295-6c16-4cd1-ba6b-ae3838b41b33 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received unexpected event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 for instance with vm_state active and task_state rescuing.
Nov 07 15:32:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e -F raw /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk" returned: 0 in 2.757s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Ensure instance console log exists: /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Start _get_guest_xml network_info=[{"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='33cd464e15a2f5efde8ac479e54985b0',container_format='bare',created_at=2023-11-07T15:30:45Z,direct_url=<?>,disk_format='qcow2',id=b35d981f-bfc5-444c-bd06-372690a5e8f6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-69325560-shelved',owner='e1d8e2c039d94beea94f85d8d5a95d95',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-07T15:30:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:32:46 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:32:46 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='33cd464e15a2f5efde8ac479e54985b0',container_format='bare',created_at=2023-11-07T15:30:45Z,direct_url=<?>,disk_format='qcow2',id=b35d981f-bfc5-444c-bd06-372690a5e8f6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-69325560-shelved',owner='e1d8e2c039d94beea94f85d8d5a95d95',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-07T15:30:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.objects.instance [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'vcpu_model' on Instance uuid ca4ef7a3-718c-40c0-a2e0-bb636fc2214d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.objects.base [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Object Instance<ca4ef7a3-718c-40c0-a2e0-bb636fc2214d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T15:28:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-69325560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-69325560',id=19,image_ref='b35d981f-bfc5-444c-bd06-372690a5e8f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-685240993',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:28:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e1d8e2c039d94beea94f85d8d5a95d95',ramdisk_id='',reservation_id='r-n25mco0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-175335890',owner_user_name='tempest-AttachVolumeShelveTestJSON-175335890-project-member',shelved_at='2023-11-07T15:30:50.440145',shelved_host='user',shelved_image_id='b35d981f-bfc5-444c-bd06-372690a5e8f6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:32:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c7596f1e0e748728fa459908f89aede',uuid=ca4ef7a3-718c-40c0-a2e0-bb636fc2214d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converting VIF {"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:62:d5,bridge_name='br-int',has_traffic_filtering=True,id=1a222150-39b6-4eb8-8502-379bd9f9f468,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a222150-39') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.objects.instance [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'pci_devices' on Instance uuid ca4ef7a3-718c-40c0-a2e0-bb636fc2214d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.objects.base [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Object Instance<ca4ef7a3-718c-40c0-a2e0-bb636fc2214d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:32:46 user nova-compute[75018]:   <uuid>ca4ef7a3-718c-40c0-a2e0-bb636fc2214d</uuid>
Nov 07 15:32:46 user nova-compute[75018]:   <name>instance-00000013</name>
Nov 07 15:32:46 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:32:46 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:32:46 user nova-compute[75018]:   <metadata>
Nov 07 15:32:46 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:32:46 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:32:46 user nova-compute[75018]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-69325560</nova:name>
Nov 07 15:32:46 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:32:46</nova:creationTime>
Nov 07 15:32:46 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:32:46 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:32:46 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:32:46 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:32:46 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:32:46 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:32:46 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:32:46 user nova-compute[75018]:       <nova:owner>
Nov 07 15:32:46 user nova-compute[75018]:         <nova:user uuid="9c7596f1e0e748728fa459908f89aede">tempest-AttachVolumeShelveTestJSON-175335890-project-member</nova:user>
Nov 07 15:32:46 user nova-compute[75018]:         <nova:project uuid="e1d8e2c039d94beea94f85d8d5a95d95">tempest-AttachVolumeShelveTestJSON-175335890</nova:project>
Nov 07 15:32:46 user nova-compute[75018]:       </nova:owner>
Nov 07 15:32:46 user nova-compute[75018]:       <nova:root type="image" uuid="b35d981f-bfc5-444c-bd06-372690a5e8f6"/>
Nov 07 15:32:46 user nova-compute[75018]:       <nova:ports>
Nov 07 15:32:46 user nova-compute[75018]:         <nova:port uuid="1a222150-39b6-4eb8-8502-379bd9f9f468">
Nov 07 15:32:46 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 07 15:32:46 user nova-compute[75018]:         </nova:port>
Nov 07 15:32:46 user nova-compute[75018]:       </nova:ports>
Nov 07 15:32:46 user nova-compute[75018]:     </nova:instance>
Nov 07 15:32:46 user nova-compute[75018]:   </metadata>
Nov 07 15:32:46 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:32:46 user nova-compute[75018]:     <system>
Nov 07 15:32:46 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:32:46 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:32:46 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:32:46 user nova-compute[75018]:       <entry name="serial">ca4ef7a3-718c-40c0-a2e0-bb636fc2214d</entry>
Nov 07 15:32:46 user nova-compute[75018]:       <entry name="uuid">ca4ef7a3-718c-40c0-a2e0-bb636fc2214d</entry>
Nov 07 15:32:46 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:32:46 user nova-compute[75018]:     </system>
Nov 07 15:32:46 user nova-compute[75018]:   </sysinfo>
Nov 07 15:32:46 user nova-compute[75018]:   <os>
Nov 07 15:32:46 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:32:46 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:32:46 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:32:46 user nova-compute[75018]:   </os>
Nov 07 15:32:46 user nova-compute[75018]:   <features>
Nov 07 15:32:46 user nova-compute[75018]:     <acpi/>
Nov 07 15:32:46 user nova-compute[75018]:     <apic/>
Nov 07 15:32:46 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:32:46 user nova-compute[75018]:   </features>
Nov 07 15:32:46 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:32:46 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:32:46 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:32:46 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:32:46 user nova-compute[75018]:   </clock>
Nov 07 15:32:46 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:32:46 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:32:46 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:32:46 user nova-compute[75018]:   </cpu>
Nov 07 15:32:46 user nova-compute[75018]:   <devices>
Nov 07 15:32:46 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:32:46 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:32:46 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk"/>
Nov 07 15:32:46 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:32:46 user nova-compute[75018]:     </disk>
Nov 07 15:32:46 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:32:46 user nova-compute[75018]:       <mac address="fa:16:3e:9d:62:d5"/>
Nov 07 15:32:46 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:32:46 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:32:46 user nova-compute[75018]:       <target dev="tap1a222150-39"/>
Nov 07 15:32:46 user nova-compute[75018]:     </interface>
Nov 07 15:32:46 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:32:46 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/console.log" append="off"/>
Nov 07 15:32:46 user nova-compute[75018]:     </serial>
Nov 07 15:32:46 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:32:46 user nova-compute[75018]:     <video>
Nov 07 15:32:46 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:32:46 user nova-compute[75018]:     </video>
Nov 07 15:32:46 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:32:46 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:32:46 user nova-compute[75018]:     </rng>
Nov 07 15:32:46 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:32:46 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:32:46 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:32:46 user nova-compute[75018]:     </memballoon>
Nov 07 15:32:46 user nova-compute[75018]:   </devices>
Nov 07 15:32:46 user nova-compute[75018]: </domain>
Nov 07 15:32:46 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T15:28:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-69325560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-69325560',id=19,image_ref='b35d981f-bfc5-444c-bd06-372690a5e8f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-685240993',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:28:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e1d8e2c039d94beea94f85d8d5a95d95',ramdisk_id='',reservation_id='r-n25mco0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-175335890',owner_user_name='tempest-AttachVolumeShelveTestJSON-175335890-project-member',shelved_at='2023-11-07T15:30:50.440145',shelved_host='user',shelved_image_id='b35d981f-bfc5-444c-bd06-372690a5e8f6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:32:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c7596f1e0e748728fa459908f89aede',uuid=ca4ef7a3-718c-40c0-a2e0-bb636fc2214d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converting VIF {"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:62:d5,bridge_name='br-int',has_traffic_filtering=True,id=1a222150-39b6-4eb8-8502-379bd9f9f468,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a222150-39') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG os_vif [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:62:d5,bridge_name='br-int',has_traffic_filtering=True,id=1a222150-39b6-4eb8-8502-379bd9f9f468,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a222150-39') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f6c6eb0-7dfb-5b97-9d38-31b53b359a51', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a222150-39, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a222150-39, col_values=(('qos', UUID('4cbe6b0f-d017-4bd6-a7df-2b20c3a3304f')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a222150-39, col_values=(('external_ids', {'iface-id': '1a222150-39b6-4eb8-8502-379bd9f9f468', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:62:d5', 'vm-uuid': 'ca4ef7a3-718c-40c0-a2e0-bb636fc2214d'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:46 user nova-compute[75018]: INFO os_vif [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:62:d5,bridge_name='br-int',has_traffic_filtering=True,id=1a222150-39b6-4eb8-8502-379bd9f9f468,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a222150-39')
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] No VIF found with MAC fa:16:3e:9d:62:d5, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.compute.manager [req-badf1747-1f48-4932-83e5-a0ef5b0a6a8d req-8cd92d2e-b5cf-48f5-aee5-2ebf039ebf33 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-badf1747-1f48-4932-83e5-a0ef5b0a6a8d req-8cd92d2e-b5cf-48f5-aee5-2ebf039ebf33 service nova] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-badf1747-1f48-4932-83e5-a0ef5b0a6a8d req-8cd92d2e-b5cf-48f5-aee5-2ebf039ebf33 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-badf1747-1f48-4932-83e5-a0ef5b0a6a8d req-8cd92d2e-b5cf-48f5-aee5-2ebf039ebf33 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.compute.manager [req-badf1747-1f48-4932-83e5-a0ef5b0a6a8d req-8cd92d2e-b5cf-48f5-aee5-2ebf039ebf33 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] No waiting events found dispatching network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:32:46 user nova-compute[75018]: WARNING nova.compute.manager [req-badf1747-1f48-4932-83e5-a0ef5b0a6a8d req-8cd92d2e-b5cf-48f5-aee5-2ebf039ebf33 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received unexpected event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 for instance with vm_state active and task_state rescuing.
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.compute.manager [req-badf1747-1f48-4932-83e5-a0ef5b0a6a8d req-8cd92d2e-b5cf-48f5-aee5-2ebf039ebf33 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-badf1747-1f48-4932-83e5-a0ef5b0a6a8d req-8cd92d2e-b5cf-48f5-aee5-2ebf039ebf33 service nova] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-badf1747-1f48-4932-83e5-a0ef5b0a6a8d req-8cd92d2e-b5cf-48f5-aee5-2ebf039ebf33 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-badf1747-1f48-4932-83e5-a0ef5b0a6a8d req-8cd92d2e-b5cf-48f5-aee5-2ebf039ebf33 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:46 user nova-compute[75018]: DEBUG nova.compute.manager [req-badf1747-1f48-4932-83e5-a0ef5b0a6a8d req-8cd92d2e-b5cf-48f5-aee5-2ebf039ebf33 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] No waiting events found dispatching network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:32:46 user nova-compute[75018]: WARNING nova.compute.manager [req-badf1747-1f48-4932-83e5-a0ef5b0a6a8d req-8cd92d2e-b5cf-48f5-aee5-2ebf039ebf33 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received unexpected event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 for instance with vm_state active and task_state rescuing.
Nov 07 15:32:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-56b0e892-df1c-4b4c-b933-0898e7baef16 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:32:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-49108d24-da74-4310-86d2-e4838f43d498 req-6237f9a2-a928-4c65-8740-df0cfc2fa743 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-49108d24-da74-4310-86d2-e4838f43d498 req-6237f9a2-a928-4c65-8740-df0cfc2fa743 service nova] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-49108d24-da74-4310-86d2-e4838f43d498 req-6237f9a2-a928-4c65-8740-df0cfc2fa743 service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-49108d24-da74-4310-86d2-e4838f43d498 req-6237f9a2-a928-4c65-8740-df0cfc2fa743 service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-49108d24-da74-4310-86d2-e4838f43d498 req-6237f9a2-a928-4c65-8740-df0cfc2fa743 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] No waiting events found dispatching network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:32:48 user nova-compute[75018]: WARNING nova.compute.manager [req-49108d24-da74-4310-86d2-e4838f43d498 req-6237f9a2-a928-4c65-8740-df0cfc2fa743 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received unexpected event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 07 15:32:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-49108d24-da74-4310-86d2-e4838f43d498 req-6237f9a2-a928-4c65-8740-df0cfc2fa743 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:32:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-49108d24-da74-4310-86d2-e4838f43d498 req-6237f9a2-a928-4c65-8740-df0cfc2fa743 service nova] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:32:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-49108d24-da74-4310-86d2-e4838f43d498 req-6237f9a2-a928-4c65-8740-df0cfc2fa743 service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:32:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-49108d24-da74-4310-86d2-e4838f43d498 req-6237f9a2-a928-4c65-8740-df0cfc2fa743 service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-49108d24-da74-4310-86d2-e4838f43d498 req-6237f9a2-a928-4c65-8740-df0cfc2fa743 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] No waiting events found dispatching network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:32:48 user nova-compute[75018]: WARNING nova.compute.manager [req-49108d24-da74-4310-86d2-e4838f43d498 req-6237f9a2-a928-4c65-8740-df0cfc2fa743 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received unexpected event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 07 15:32:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:32:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:32:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Instance spawned successfully.
Nov 07 15:32:51 user nova-compute[75018]: DEBUG nova.compute.manager [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:32:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545f2556-4813-4684-b83e-a327a3fe4555 tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.386s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:32:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:32:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:07 user nova-compute[75018]: INFO nova.compute.manager [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Detaching volume ac5ae7db-b2b5-451b-aced-4d4b4695ad11
Nov 07 15:33:07 user nova-compute[75018]: INFO nova.virt.block_device [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Attempting to driver detach volume ac5ae7db-b2b5-451b-aced-4d4b4695ad11 from mountpoint /dev/vdb
Nov 07 15:33:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Attempting to detach device vdb from instance af83bfa8-3661-4456-8854-f6c457e149fa from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:33:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:33:07 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:33:07 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:33:07 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:33:07 user nova-compute[75018]:   <serial>ac5ae7db-b2b5-451b-aced-4d4b4695ad11</serial>
Nov 07 15:33:07 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 15:33:07 user nova-compute[75018]: </disk>
Nov 07 15:33:07 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:33:07 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Successfully detached device vdb from instance af83bfa8-3661-4456-8854-f6c457e149fa from the persistent domain config.
Nov 07 15:33:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance af83bfa8-3661-4456-8854-f6c457e149fa from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:33:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:33:07 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:33:07 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:33:07 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:33:07 user nova-compute[75018]:   <serial>ac5ae7db-b2b5-451b-aced-4d4b4695ad11</serial>
Nov 07 15:33:07 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 15:33:07 user nova-compute[75018]: </disk>
Nov 07 15:33:07 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:33:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:33:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:33:19 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Creating image(s)
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "/opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "/opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.207s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk 1073741824" returned: 0 in 0.053s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.202s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:33:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Cannot resize image /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Ensure instance console log exists: /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Start _get_guest_xml network_info=[{"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UvVSmDLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ec5ab630-cd90-4514-aa9c-e46efc0bf78a', 'attached_at': '', 'detached_at': '', 'volume_id': '68740783-277d-46d3-8306-02c4be843940', 'serial': '68740783-277d-46d3-8306-02c4be843940'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '9bc6b08d-504a-413c-99e3-84514428c74f', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:33:20 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 07 15:33:20 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.objects.instance [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lazy-loading 'vcpu_model' on Instance uuid ec5ab630-cd90-4514-aa9c-e46efc0bf78a {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UvVSmDLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:33:20 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:33:20 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:33:20 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[74540739-fa51-4d0e-95a5-37f190f52336]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:33:20 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5c2038-0ae2-4a07-999d-f67527e7f587]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940] added
Nov 07 15:33:20 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed32f450-4400-4b1e-86d7-1ed7babceb10]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80d2d00-3877-4031-b556-6f3556ac08b6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UvVSmDLz {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UvVSmDLz" returned: 0 in 0.047s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca07795-4a1e-4b6b-a43e-76c6c752edc4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UvVSmDLz'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c8ff9b-878d-47ae-81f0-c1f1c86c01a0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:33:20 user nova-compute[75018]: INFO nova.compute.claims [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Claim successful on node user
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59e511f-5ede-4069-a078-a5676510e516]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:33:20 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:33:20 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a501a3d-a423-4e39-b800-d394c9df9b8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260]
Nov 07 15:33:20 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260] successful.
Nov 07 15:33:20 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.054s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[60106750-5091-4603-8461-1308e9c0a19b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b208e2-3bc1-4662-8953-8b7edae38403]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:33:20 user nova-compute[75018]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:33:20 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:33:20 user nova-compute[75018]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:33:20 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5d8d3a-db71-4d0d-81bd-e6f8fd389443]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UvVSmDLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:20 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:33:21 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.policy [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ae23950e1e84c9693f8098c270ecb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772e759d9a1d4d18ae43f53c731f87f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:33:21 user nova-compute[75018]: INFO nova.virt.block_device [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Booting with volume snapshot 9a25e8eb-8629-4fc2-b799-010c8d99ddd6 at /dev/vda
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23634313061363666', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634313061363666', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T15:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-517169496',display_name='tempest-ServerActionsTestOtherA-server-73412978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-517169496',id=21,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1ib+IZkBUNZq/XSdHL5Mc3rWOjMKRZFDEv86GX4KYwSkRk0NwDBdXdk6iDYaPUir2kHQPF7s/yHU1b885XgqSAd/BtsiAhqj5T9Mo8OTRLSnj98TUeFLSeVstXTuztMA==',key_name='tempest-keypair-1509984004',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:29:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-wrpoydl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:32:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=ec5ab630-cd90-4514-aa9c-e46efc0bf78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=340a2fcc-5b10-40db-90d7-646e5d265735,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340a2fcc-5b') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:33:21 user nova-compute[75018]:   <uuid>ec5ab630-cd90-4514-aa9c-e46efc0bf78a</uuid>
Nov 07 15:33:21 user nova-compute[75018]:   <name>instance-00000015</name>
Nov 07 15:33:21 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:33:21 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:33:21 user nova-compute[75018]:   <metadata>
Nov 07 15:33:21 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:33:21 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:33:21 user nova-compute[75018]:       <nova:name>tempest-ServerActionsTestOtherA-server-73412978</nova:name>
Nov 07 15:33:21 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:33:20</nova:creationTime>
Nov 07 15:33:21 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:33:21 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:33:21 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:33:21 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:33:21 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:33:21 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:33:21 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:33:21 user nova-compute[75018]:       <nova:owner>
Nov 07 15:33:21 user nova-compute[75018]:         <nova:user uuid="c6b39ca6e2db4be9a71fca8389bce83f">tempest-ServerActionsTestOtherA-1198683339-project-member</nova:user>
Nov 07 15:33:21 user nova-compute[75018]:         <nova:project uuid="8da5c809b9e14547855ac986915e8c99">tempest-ServerActionsTestOtherA-1198683339</nova:project>
Nov 07 15:33:21 user nova-compute[75018]:       </nova:owner>
Nov 07 15:33:21 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:33:21 user nova-compute[75018]:       <nova:ports>
Nov 07 15:33:21 user nova-compute[75018]:         <nova:port uuid="340a2fcc-5b10-40db-90d7-646e5d265735">
Nov 07 15:33:21 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 15:33:21 user nova-compute[75018]:         </nova:port>
Nov 07 15:33:21 user nova-compute[75018]:       </nova:ports>
Nov 07 15:33:21 user nova-compute[75018]:     </nova:instance>
Nov 07 15:33:21 user nova-compute[75018]:   </metadata>
Nov 07 15:33:21 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:33:21 user nova-compute[75018]:     <system>
Nov 07 15:33:21 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:33:21 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:33:21 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:33:21 user nova-compute[75018]:       <entry name="serial">ec5ab630-cd90-4514-aa9c-e46efc0bf78a</entry>
Nov 07 15:33:21 user nova-compute[75018]:       <entry name="uuid">ec5ab630-cd90-4514-aa9c-e46efc0bf78a</entry>
Nov 07 15:33:21 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:33:21 user nova-compute[75018]:     </system>
Nov 07 15:33:21 user nova-compute[75018]:   </sysinfo>
Nov 07 15:33:21 user nova-compute[75018]:   <os>
Nov 07 15:33:21 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:33:21 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:33:21 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:33:21 user nova-compute[75018]:   </os>
Nov 07 15:33:21 user nova-compute[75018]:   <features>
Nov 07 15:33:21 user nova-compute[75018]:     <acpi/>
Nov 07 15:33:21 user nova-compute[75018]:     <apic/>
Nov 07 15:33:21 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:33:21 user nova-compute[75018]:   </features>
Nov 07 15:33:21 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:33:21 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:33:21 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:33:21 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:33:21 user nova-compute[75018]:   </clock>
Nov 07 15:33:21 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:33:21 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:33:21 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:33:21 user nova-compute[75018]:   </cpu>
Nov 07 15:33:21 user nova-compute[75018]:   <devices>
Nov 07 15:33:21 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:33:21 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:33:21 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk"/>
Nov 07 15:33:21 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:33:21 user nova-compute[75018]:     </disk>
Nov 07 15:33:21 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:33:21 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:33:21 user nova-compute[75018]:       <source dev="/dev/sdb"/>
Nov 07 15:33:21 user nova-compute[75018]:       <target dev="vdb" bus="virtio"/>
Nov 07 15:33:21 user nova-compute[75018]:       <serial>68740783-277d-46d3-8306-02c4be843940</serial>
Nov 07 15:33:21 user nova-compute[75018]:     </disk>
Nov 07 15:33:21 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:33:21 user nova-compute[75018]:       <mac address="fa:16:3e:0e:3b:23"/>
Nov 07 15:33:21 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:33:21 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:33:21 user nova-compute[75018]:       <target dev="tap340a2fcc-5b"/>
Nov 07 15:33:21 user nova-compute[75018]:     </interface>
Nov 07 15:33:21 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:33:21 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/console.log" append="off"/>
Nov 07 15:33:21 user nova-compute[75018]:     </serial>
Nov 07 15:33:21 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:33:21 user nova-compute[75018]:     <video>
Nov 07 15:33:21 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:33:21 user nova-compute[75018]:     </video>
Nov 07 15:33:21 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:33:21 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:33:21 user nova-compute[75018]:     </rng>
Nov 07 15:33:21 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:33:21 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:33:21 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:33:21 user nova-compute[75018]:     </memballoon>
Nov 07 15:33:21 user nova-compute[75018]:   </devices>
Nov 07 15:33:21 user nova-compute[75018]: </domain>
Nov 07 15:33:21 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T15:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-517169496',display_name='tempest-ServerActionsTestOtherA-server-73412978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-517169496',id=21,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1ib+IZkBUNZq/XSdHL5Mc3rWOjMKRZFDEv86GX4KYwSkRk0NwDBdXdk6iDYaPUir2kHQPF7s/yHU1b885XgqSAd/BtsiAhqj5T9Mo8OTRLSnj98TUeFLSeVstXTuztMA==',key_name='tempest-keypair-1509984004',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:29:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-wrpoydl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:32:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=ec5ab630-cd90-4514-aa9c-e46efc0bf78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=340a2fcc-5b10-40db-90d7-646e5d265735,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340a2fcc-5b') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG os_vif [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=340a2fcc-5b10-40db-90d7-646e5d265735,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340a2fcc-5b') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd805614-c413-56a2-a3a9-33a968a96c31', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap340a2fcc-5b, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap340a2fcc-5b, col_values=(('qos', UUID('63a91841-aaab-437e-8979-7a0ad1722164')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap340a2fcc-5b, col_values=(('external_ids', {'iface-id': '340a2fcc-5b10-40db-90d7-646e5d265735', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:3b:23', 'vm-uuid': 'ec5ab630-cd90-4514-aa9c-e46efc0bf78a'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:21 user nova-compute[75018]: INFO os_vif [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=340a2fcc-5b10-40db-90d7-646e5d265735,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340a2fcc-5b')
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Successfully created port: f9787286-327a-418d-9ec0-961d70e33a5e {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:33:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] No VIF found with MAC fa:16:3e:0e:3b:23, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:33:22 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Successfully updated port: f9787286-327a-418d-9ec0-961d70e33a5e {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:33:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "refresh_cache-6fb123ab-d591-4bdc-adb0-1bf924a46db2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:33:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquired lock "refresh_cache-6fb123ab-d591-4bdc-adb0-1bf924a46db2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:33:22 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:33:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-cd122872-8322-4095-bb22-dc6a498c7b8e req-f224c175-224a-41e7-8890-a5d11258e580 service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Received event network-changed-f9787286-327a-418d-9ec0-961d70e33a5e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:33:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-cd122872-8322-4095-bb22-dc6a498c7b8e req-f224c175-224a-41e7-8890-a5d11258e580 service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Refreshing instance network info cache due to event network-changed-f9787286-327a-418d-9ec0-961d70e33a5e. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:33:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cd122872-8322-4095-bb22-dc6a498c7b8e req-f224c175-224a-41e7-8890-a5d11258e580 service nova] Acquiring lock "refresh_cache-6fb123ab-d591-4bdc-adb0-1bf924a46db2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:33:22 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Updating instance_info_cache with network_info: [{"id": "f9787286-327a-418d-9ec0-961d70e33a5e", "address": "fa:16:3e:e5:e2:31", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9787286-32", "ovs_interfaceid": "f9787286-327a-418d-9ec0-961d70e33a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Releasing lock "refresh_cache-6fb123ab-d591-4bdc-adb0-1bf924a46db2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Instance network_info: |[{"id": "f9787286-327a-418d-9ec0-961d70e33a5e", "address": "fa:16:3e:e5:e2:31", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9787286-32", "ovs_interfaceid": "f9787286-327a-418d-9ec0-961d70e33a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cd122872-8322-4095-bb22-dc6a498c7b8e req-f224c175-224a-41e7-8890-a5d11258e580 service nova] Acquired lock "refresh_cache-6fb123ab-d591-4bdc-adb0-1bf924a46db2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG nova.network.neutron [req-cd122872-8322-4095-bb22-dc6a498c7b8e req-f224c175-224a-41e7-8890-a5d11258e580 service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Refreshing network info cache for port f9787286-327a-418d-9ec0-961d70e33a5e {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG nova.compute.manager [req-acfd76e0-bb66-4dba-967d-afde17c75d31 req-df9b858a-128d-4e7b-94a9-8cef37e18e59 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-acfd76e0-bb66-4dba-967d-afde17c75d31 req-df9b858a-128d-4e7b-94a9-8cef37e18e59 service nova] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-acfd76e0-bb66-4dba-967d-afde17c75d31 req-df9b858a-128d-4e7b-94a9-8cef37e18e59 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-acfd76e0-bb66-4dba-967d-afde17c75d31 req-df9b858a-128d-4e7b-94a9-8cef37e18e59 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG nova.compute.manager [req-acfd76e0-bb66-4dba-967d-afde17c75d31 req-df9b858a-128d-4e7b-94a9-8cef37e18e59 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] No waiting events found dispatching network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:33:23 user nova-compute[75018]: WARNING nova.compute.manager [req-acfd76e0-bb66-4dba-967d-afde17c75d31 req-df9b858a-128d-4e7b-94a9-8cef37e18e59 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received unexpected event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 for instance with vm_state active and task_state rebuild_spawning.
Nov 07 15:33:23 user nova-compute[75018]: DEBUG nova.network.neutron [req-cd122872-8322-4095-bb22-dc6a498c7b8e req-f224c175-224a-41e7-8890-a5d11258e580 service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Updated VIF entry in instance network info cache for port f9787286-327a-418d-9ec0-961d70e33a5e. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG nova.network.neutron [req-cd122872-8322-4095-bb22-dc6a498c7b8e req-f224c175-224a-41e7-8890-a5d11258e580 service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Updating instance_info_cache with network_info: [{"id": "f9787286-327a-418d-9ec0-961d70e33a5e", "address": "fa:16:3e:e5:e2:31", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9787286-32", "ovs_interfaceid": "f9787286-327a-418d-9ec0-961d70e33a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:33:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cd122872-8322-4095-bb22-dc6a498c7b8e req-f224c175-224a-41e7-8890-a5d11258e580 service nova] Releasing lock "refresh_cache-6fb123ab-d591-4bdc-adb0-1bf924a46db2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:33:25 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Instance spawned successfully.
Nov 07 15:33:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-997fb1a1-b8bc-45b0-aa7d-580ff00633f6 req-f4d44d76-1feb-44f3-b4a3-3f21299bf798 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-997fb1a1-b8bc-45b0-aa7d-580ff00633f6 req-f4d44d76-1feb-44f3-b4a3-3f21299bf798 service nova] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-997fb1a1-b8bc-45b0-aa7d-580ff00633f6 req-f4d44d76-1feb-44f3-b4a3-3f21299bf798 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-997fb1a1-b8bc-45b0-aa7d-580ff00633f6 req-f4d44d76-1feb-44f3-b4a3-3f21299bf798 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-997fb1a1-b8bc-45b0-aa7d-580ff00633f6 req-f4d44d76-1feb-44f3-b4a3-3f21299bf798 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] No waiting events found dispatching network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:33:25 user nova-compute[75018]: WARNING nova.compute.manager [req-997fb1a1-b8bc-45b0-aa7d-580ff00633f6 req-f4d44d76-1feb-44f3-b4a3-3f21299bf798 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received unexpected event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 for instance with vm_state active and task_state rebuild_spawning.
Nov 07 15:33:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG nova.objects.instance [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75018) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 07 15:33:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70d16ee1-e7f0-405d-90c3-830d9a89ef00 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.080s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:26 user nova-compute[75018]: DEBUG os_brick.utils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:33:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d536ef98-4167-4df0-9a82-27246c33d96a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2f902c-4229-4a83-be5d-6750e6aeb635]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[725e4c3d-d9fe-4796-a842-b7c18fa163d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4639f57c-adb5-463d-a69a-e828dc862b1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:33:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:33:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:33:27 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:33:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4de9d6-baae-44dd-96d3-984164e3a668]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:33:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:33:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:33:27 user nova-compute[75018]: DEBUG os_brick.utils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:33:27 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Updating existing volume attachment record: cde9fe60-6e1b-4720-acb9-c602d781c6c0 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:33:28 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance af83bfa8-3661-4456-8854-f6c457e149fa is timed out.
Nov 07 15:33:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Successfully detached device vdb from instance af83bfa8-3661-4456-8854-f6c457e149fa from the live domain config.
Nov 07 15:33:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYhTCRdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:33:28 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6621b1f-526d-4b94-908e-2c6af831d6c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:33:28 user nova-compute[75018]: No targets found.
Nov 07 15:33:28 user nova-compute[75018]: iSNS:
Nov 07 15:33:28 user nova-compute[75018]: No targets found.
Nov 07 15:33:28 user nova-compute[75018]: STATIC:
Nov 07 15:33:28 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11
Nov 07 15:33:28 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:33:28 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:33:28 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940
Nov 07 15:33:28 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:33:28 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:33:28 user nova-compute[75018]: FIRMWARE:
Nov 07 15:33:28 user nova-compute[75018]: No targets found.
Nov 07 15:33:28 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:33:28 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:33:28 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[35719d63-5bb9-401d-b9e4-36a79ef1dda9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e483272-da6b-453a-ab79-b43b54061b3a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:33:28 user nova-compute[75018]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:33:28 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 (non-flash)
Nov 07 15:33:28 user nova-compute[75018]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:33:28 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae049d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11'): ({'sdd'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Removing single pathed devices sdd {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6d0801-806b-49ee-86c7-9997f4d01bce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[99af7ea9-dbe1-4a25-b9aa-c4805cacad5b]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Flushing IO for device /dev/sdd {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d75690-d20f-4378-85e6-81765e65e496]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdc467c-7f40-41e6-93aa-b8aeaae02445]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[61de1428-01f0-4a7d-91c0-0d98eade5f1d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8cbcb0-fd5e-4612-9cad-75255b9d9983]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260]
Nov 07 15:33:28 user nova-compute[75018]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11, portal: 172.16.0.220,3260] successful.
Nov 07 15:33:28 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5ae7db-b2b5-451b-aced-4d4b4695ad11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[67edc4f1-f34b-4cea-b787-aac0e6f94296]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] <== disconnect_volume: return (388ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:33:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:33:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:33:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:33:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:33:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:33:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:33:31 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:33:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:33:31 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:33:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:33:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:33:31 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:33:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:32 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Updating instance_info_cache with network_info: [{"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:33:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:33:32 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:33:32 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:33:33 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:33:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:33 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:33:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:33:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:37 user nova-compute[75018]: DEBUG nova.compute.manager [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:33:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:37 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:33:37 user nova-compute[75018]: INFO nova.compute.claims [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Claim successful on node user
Nov 07 15:33:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk.rescue --force-share --output=json" returned: 0 in 0.275s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:38 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:33:38 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:33:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.735s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:33:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:33:38 user nova-compute[75018]: DEBUG nova.network.neutron [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.policy [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6096aee5520e4cc4a9f34fdef6bae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba46e41b23a4c1b93fa1e8b03715ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:33:39 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:33:39 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:33:39 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7529MB free_disk=25.130596160888672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.manager [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance af83bfa8-3661-4456-8854-f6c457e149fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 31e90a00-c2df-493c-9b7e-12d3063b877f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa9e2a83-4f50-446b-a5d0-3caaca251953 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance ca4ef7a3-718c-40c0-a2e0-bb636fc2214d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 6fb123ab-d591-4bdc-adb0-1bf924a46db2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.manager [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:33:39 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Creating image(s)
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "/opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "/opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.233s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.198s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/disk 1073741824" returned: 0 in 0.059s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.network.neutron [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Successfully created port: 7a9cf4d0-ac7d-4d89-b175-c6519bb86979 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:33:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.844s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.210s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Cannot resize image /opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Ensure instance console log exists: /opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG nova.network.neutron [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Successfully updated port: 7a9cf4d0-ac7d-4d89-b175-c6519bb86979 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "refresh_cache-2e5c462d-2ce2-4b95-816e-ac7ee26e85bf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquired lock "refresh_cache-2e5c462d-2ce2-4b95-816e-ac7ee26e85bf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG nova.network.neutron [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG nova.compute.manager [req-c4a22657-ff06-4828-962c-03885b6cf4ec req-54bd5520-ece8-4ebc-810d-882062f16a7a service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Received event network-changed-7a9cf4d0-ac7d-4d89-b175-c6519bb86979 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG nova.compute.manager [req-c4a22657-ff06-4828-962c-03885b6cf4ec req-54bd5520-ece8-4ebc-810d-882062f16a7a service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Refreshing instance network info cache due to event network-changed-7a9cf4d0-ac7d-4d89-b175-c6519bb86979. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c4a22657-ff06-4828-962c-03885b6cf4ec req-54bd5520-ece8-4ebc-810d-882062f16a7a service nova] Acquiring lock "refresh_cache-2e5c462d-2ce2-4b95-816e-ac7ee26e85bf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG nova.network.neutron [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:33:40 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.objects.instance [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'flavor' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e6d5859-9c44-40d3-8415-d2ec04a6b6ab tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 33.372s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Updating instance_info_cache with network_info: [{"id": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "address": "fa:16:3e:ac:2e:84", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cf4d0-ac", "ovs_interfaceid": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Releasing lock "refresh_cache-2e5c462d-2ce2-4b95-816e-ac7ee26e85bf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Instance network_info: |[{"id": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "address": "fa:16:3e:ac:2e:84", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cf4d0-ac", "ovs_interfaceid": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c4a22657-ff06-4828-962c-03885b6cf4ec req-54bd5520-ece8-4ebc-810d-882062f16a7a service nova] Acquired lock "refresh_cache-2e5c462d-2ce2-4b95-816e-ac7ee26e85bf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.network.neutron [req-c4a22657-ff06-4828-962c-03885b6cf4ec req-54bd5520-ece8-4ebc-810d-882062f16a7a service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Refreshing network info cache for port 7a9cf4d0-ac7d-4d89-b175-c6519bb86979 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Start _get_guest_xml network_info=[{"id": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "address": "fa:16:3e:ac:2e:84", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cf4d0-ac", "ovs_interfaceid": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:33:41 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:33:41 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1088743790',display_name='tempest-ServersNegativeTestJSON-server-1088743790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1088743790',id=26,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aba46e41b23a4c1b93fa1e8b03715ba8',ramdisk_id='',reservation_id='r-n7jriw7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1403438128',owner_user_name='tempest-ServersNegativeTestJSON-1403438128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:33:39Z,user_data=None,user_id='6096aee5520e4cc4a9f34fdef6bae6da',uuid=2e5c462d-2ce2-4b95-816e-ac7ee26e85bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "address": "fa:16:3e:ac:2e:84", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cf4d0-ac", "ovs_interfaceid": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Converting VIF {"id": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "address": "fa:16:3e:ac:2e:84", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cf4d0-ac", "ovs_interfaceid": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2e:84,bridge_name='br-int',has_traffic_filtering=True,id=7a9cf4d0-ac7d-4d89-b175-c6519bb86979,network=Network(4360a01c-f5c5-4d5f-86f0-0ace428bfe0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9cf4d0-ac') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.objects.instance [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-36c6702c-c816-4179-98d3-cf649cef5030 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-36c6702c-c816-4179-98d3-cf649cef5030 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-36c6702c-c816-4179-98d3-cf649cef5030 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:33:41 user nova-compute[75018]:   <uuid>2e5c462d-2ce2-4b95-816e-ac7ee26e85bf</uuid>
Nov 07 15:33:41 user nova-compute[75018]:   <name>instance-0000001a</name>
Nov 07 15:33:41 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:33:41 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:33:41 user nova-compute[75018]:   <metadata>
Nov 07 15:33:41 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:33:41 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:33:41 user nova-compute[75018]:       <nova:name>tempest-ServersNegativeTestJSON-server-1088743790</nova:name>
Nov 07 15:33:41 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:33:41</nova:creationTime>
Nov 07 15:33:41 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:33:41 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:33:41 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:33:41 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:33:41 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:33:41 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:33:41 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:33:41 user nova-compute[75018]:       <nova:owner>
Nov 07 15:33:41 user nova-compute[75018]:         <nova:user uuid="6096aee5520e4cc4a9f34fdef6bae6da">tempest-ServersNegativeTestJSON-1403438128-project-member</nova:user>
Nov 07 15:33:41 user nova-compute[75018]:         <nova:project uuid="aba46e41b23a4c1b93fa1e8b03715ba8">tempest-ServersNegativeTestJSON-1403438128</nova:project>
Nov 07 15:33:41 user nova-compute[75018]:       </nova:owner>
Nov 07 15:33:41 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:33:41 user nova-compute[75018]:       <nova:ports>
Nov 07 15:33:41 user nova-compute[75018]:         <nova:port uuid="7a9cf4d0-ac7d-4d89-b175-c6519bb86979">
Nov 07 15:33:41 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 15:33:41 user nova-compute[75018]:         </nova:port>
Nov 07 15:33:41 user nova-compute[75018]:       </nova:ports>
Nov 07 15:33:41 user nova-compute[75018]:     </nova:instance>
Nov 07 15:33:41 user nova-compute[75018]:   </metadata>
Nov 07 15:33:41 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:33:41 user nova-compute[75018]:     <system>
Nov 07 15:33:41 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:33:41 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:33:41 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:33:41 user nova-compute[75018]:       <entry name="serial">2e5c462d-2ce2-4b95-816e-ac7ee26e85bf</entry>
Nov 07 15:33:41 user nova-compute[75018]:       <entry name="uuid">2e5c462d-2ce2-4b95-816e-ac7ee26e85bf</entry>
Nov 07 15:33:41 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:33:41 user nova-compute[75018]:     </system>
Nov 07 15:33:41 user nova-compute[75018]:   </sysinfo>
Nov 07 15:33:41 user nova-compute[75018]:   <os>
Nov 07 15:33:41 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:33:41 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:33:41 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:33:41 user nova-compute[75018]:   </os>
Nov 07 15:33:41 user nova-compute[75018]:   <features>
Nov 07 15:33:41 user nova-compute[75018]:     <acpi/>
Nov 07 15:33:41 user nova-compute[75018]:     <apic/>
Nov 07 15:33:41 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:33:41 user nova-compute[75018]:   </features>
Nov 07 15:33:41 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:33:41 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:33:41 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:33:41 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:33:41 user nova-compute[75018]:   </clock>
Nov 07 15:33:41 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:33:41 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:33:41 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:33:41 user nova-compute[75018]:   </cpu>
Nov 07 15:33:41 user nova-compute[75018]:   <devices>
Nov 07 15:33:41 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:33:41 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:33:41 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/disk"/>
Nov 07 15:33:41 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:33:41 user nova-compute[75018]:     </disk>
Nov 07 15:33:41 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:33:41 user nova-compute[75018]:       <mac address="fa:16:3e:ac:2e:84"/>
Nov 07 15:33:41 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:33:41 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:33:41 user nova-compute[75018]:       <target dev="tap7a9cf4d0-ac"/>
Nov 07 15:33:41 user nova-compute[75018]:     </interface>
Nov 07 15:33:41 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:33:41 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/console.log" append="off"/>
Nov 07 15:33:41 user nova-compute[75018]:     </serial>
Nov 07 15:33:41 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:33:41 user nova-compute[75018]:     <video>
Nov 07 15:33:41 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:33:41 user nova-compute[75018]:     </video>
Nov 07 15:33:41 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:33:41 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:33:41 user nova-compute[75018]:     </rng>
Nov 07 15:33:41 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:33:41 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:33:41 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:33:41 user nova-compute[75018]:     </memballoon>
Nov 07 15:33:41 user nova-compute[75018]:   </devices>
Nov 07 15:33:41 user nova-compute[75018]: </domain>
Nov 07 15:33:41 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1088743790',display_name='tempest-ServersNegativeTestJSON-server-1088743790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1088743790',id=26,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aba46e41b23a4c1b93fa1e8b03715ba8',ramdisk_id='',reservation_id='r-n7jriw7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1403438128',owner_user_name='tempest-ServersNegativeTestJSON-1403438128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:33:39Z,user_data=None,user_id='6096aee5520e4cc4a9f34fdef6bae6da',uuid=2e5c462d-2ce2-4b95-816e-ac7ee26e85bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "address": "fa:16:3e:ac:2e:84", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cf4d0-ac", "ovs_interfaceid": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Converting VIF {"id": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "address": "fa:16:3e:ac:2e:84", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cf4d0-ac", "ovs_interfaceid": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2e:84,bridge_name='br-int',has_traffic_filtering=True,id=7a9cf4d0-ac7d-4d89-b175-c6519bb86979,network=Network(4360a01c-f5c5-4d5f-86f0-0ace428bfe0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9cf4d0-ac') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG os_vif [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2e:84,bridge_name='br-int',has_traffic_filtering=True,id=7a9cf4d0-ac7d-4d89-b175-c6519bb86979,network=Network(4360a01c-f5c5-4d5f-86f0-0ace428bfe0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9cf4d0-ac') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfe8dd24-eefe-57dc-a927-6c29b8556aae', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-36c6702c-c816-4179-98d3-cf649cef5030 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75018) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.objects.instance [None req-36c6702c-c816-4179-98d3-cf649cef5030 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'flavor' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a9cf4d0-ac, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a9cf4d0-ac, col_values=(('qos', UUID('13ec5b99-861b-499d-b923-f69c6c553c7c')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a9cf4d0-ac, col_values=(('external_ids', {'iface-id': '7a9cf4d0-ac7d-4d89-b175-c6519bb86979', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:2e:84', 'vm-uuid': '2e5c462d-2ce2-4b95-816e-ac7ee26e85bf'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:41 user nova-compute[75018]: INFO os_vif [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2e:84,bridge_name='br-int',has_traffic_filtering=True,id=7a9cf4d0-ac7d-4d89-b175-c6519bb86979,network=Network(4360a01c-f5c5-4d5f-86f0-0ace428bfe0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9cf4d0-ac')
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] No VIF found with MAC fa:16:3e:ac:2e:84, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.compute.manager [req-f8430e5c-3720-4990-8cdb-4dec355ef542 req-dad07242-a355-4b42-80e0-079d0163af90 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-vif-unplugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8430e5c-3720-4990-8cdb-4dec355ef542 req-dad07242-a355-4b42-80e0-079d0163af90 service nova] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8430e5c-3720-4990-8cdb-4dec355ef542 req-dad07242-a355-4b42-80e0-079d0163af90 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f8430e5c-3720-4990-8cdb-4dec355ef542 req-dad07242-a355-4b42-80e0-079d0163af90 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.compute.manager [req-f8430e5c-3720-4990-8cdb-4dec355ef542 req-dad07242-a355-4b42-80e0-079d0163af90 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] No waiting events found dispatching network-vif-unplugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:33:41 user nova-compute[75018]: WARNING nova.compute.manager [req-f8430e5c-3720-4990-8cdb-4dec355ef542 req-dad07242-a355-4b42-80e0-079d0163af90 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received unexpected event network-vif-unplugged-305ed47b-06ed-48aa-9584-70e46a35bded for instance with vm_state active and task_state powering-off.
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.network.neutron [req-c4a22657-ff06-4828-962c-03885b6cf4ec req-54bd5520-ece8-4ebc-810d-882062f16a7a service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Updated VIF entry in instance network info cache for port 7a9cf4d0-ac7d-4d89-b175-c6519bb86979. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG nova.network.neutron [req-c4a22657-ff06-4828-962c-03885b6cf4ec req-54bd5520-ece8-4ebc-810d-882062f16a7a service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Updating instance_info_cache with network_info: [{"id": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "address": "fa:16:3e:ac:2e:84", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cf4d0-ac", "ovs_interfaceid": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:33:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c4a22657-ff06-4828-962c-03885b6cf4ec req-54bd5520-ece8-4ebc-810d-882062f16a7a service nova] Releasing lock "refresh_cache-2e5c462d-2ce2-4b95-816e-ac7ee26e85bf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:33:42 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Instance destroyed successfully.
Nov 07 15:33:42 user nova-compute[75018]: DEBUG nova.compute.manager [None req-36c6702c-c816-4179-98d3-cf649cef5030 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:33:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-36c6702c-c816-4179-98d3-cf649cef5030 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.368s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-b168ceb5-8936-4d63-b3bf-4e5285d836db req-3f351435-4c91-4016-a6e5-ac3f38298144 service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Received event network-vif-plugged-7a9cf4d0-ac7d-4d89-b175-c6519bb86979 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:33:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b168ceb5-8936-4d63-b3bf-4e5285d836db req-3f351435-4c91-4016-a6e5-ac3f38298144 service nova] Acquiring lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b168ceb5-8936-4d63-b3bf-4e5285d836db req-3f351435-4c91-4016-a6e5-ac3f38298144 service nova] Lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b168ceb5-8936-4d63-b3bf-4e5285d836db req-3f351435-4c91-4016-a6e5-ac3f38298144 service nova] Lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-b168ceb5-8936-4d63-b3bf-4e5285d836db req-3f351435-4c91-4016-a6e5-ac3f38298144 service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] No waiting events found dispatching network-vif-plugged-7a9cf4d0-ac7d-4d89-b175-c6519bb86979 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:33:43 user nova-compute[75018]: WARNING nova.compute.manager [req-b168ceb5-8936-4d63-b3bf-4e5285d836db req-3f351435-4c91-4016-a6e5-ac3f38298144 service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Received unexpected event network-vif-plugged-7a9cf4d0-ac7d-4d89-b175-c6519bb86979 for instance with vm_state building and task_state spawning.
Nov 07 15:33:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-38867a8a-ecf4-4369-9af8-fd17923e5bb3 req-b4f98ed5-299d-40a9-8442-e51068585732 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:33:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-38867a8a-ecf4-4369-9af8-fd17923e5bb3 req-b4f98ed5-299d-40a9-8442-e51068585732 service nova] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-38867a8a-ecf4-4369-9af8-fd17923e5bb3 req-b4f98ed5-299d-40a9-8442-e51068585732 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-38867a8a-ecf4-4369-9af8-fd17923e5bb3 req-b4f98ed5-299d-40a9-8442-e51068585732 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-38867a8a-ecf4-4369-9af8-fd17923e5bb3 req-b4f98ed5-299d-40a9-8442-e51068585732 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] No waiting events found dispatching network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:33:43 user nova-compute[75018]: WARNING nova.compute.manager [req-38867a8a-ecf4-4369-9af8-fd17923e5bb3 req-b4f98ed5-299d-40a9-8442-e51068585732 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received unexpected event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded for instance with vm_state stopped and task_state None.
Nov 07 15:33:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG nova.objects.instance [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lazy-loading 'flavor' on Instance uuid 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:33:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Ignoring supplied device name: /dev/vdb
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:45 user nova-compute[75018]: INFO nova.compute.manager [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Attaching volume 114ee768-b3d6-48c2-9e59-cda69f9f8d12 to /dev/vdb
Nov 07 15:33:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-59696b81-75e3-49b4-b241-585eba2cfa21 req-cbac6ce8-619c-4cec-bfb6-9c3eb6a1962f service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Received event network-vif-plugged-7a9cf4d0-ac7d-4d89-b175-c6519bb86979 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-59696b81-75e3-49b4-b241-585eba2cfa21 req-cbac6ce8-619c-4cec-bfb6-9c3eb6a1962f service nova] Acquiring lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-59696b81-75e3-49b4-b241-585eba2cfa21 req-cbac6ce8-619c-4cec-bfb6-9c3eb6a1962f service nova] Lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-59696b81-75e3-49b4-b241-585eba2cfa21 req-cbac6ce8-619c-4cec-bfb6-9c3eb6a1962f service nova] Lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-59696b81-75e3-49b4-b241-585eba2cfa21 req-cbac6ce8-619c-4cec-bfb6-9c3eb6a1962f service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] No waiting events found dispatching network-vif-plugged-7a9cf4d0-ac7d-4d89-b175-c6519bb86979 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:33:45 user nova-compute[75018]: WARNING nova.compute.manager [req-59696b81-75e3-49b4-b241-585eba2cfa21 req-cbac6ce8-619c-4cec-bfb6-9c3eb6a1962f service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Received unexpected event network-vif-plugged-7a9cf4d0-ac7d-4d89-b175-c6519bb86979 for instance with vm_state building and task_state spawning.
Nov 07 15:33:45 user nova-compute[75018]: DEBUG os_brick.utils [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c58b2ce-a48f-4ef1-8c81-b529e7a7c08e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dca34bd-f200-4975-8190-e4ccd4dc6bb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe25298f-d831-4b46-b792-3e95968b6f0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a1d34d-5df3-41dd-a31a-b8157b7cb948]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-81225704-1efb-4f69-8c4a-2bfc87ea1581 req-1c10a7d0-1ca6-483b-bebe-60d946f3bd1e service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Received event network-changed-ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-81225704-1efb-4f69-8c4a-2bfc87ea1581 req-1c10a7d0-1ca6-483b-bebe-60d946f3bd1e service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Refreshing instance network info cache due to event network-changed-ecda3b03-86ac-4e5f-a1b1-d28806f2512a. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-81225704-1efb-4f69-8c4a-2bfc87ea1581 req-1c10a7d0-1ca6-483b-bebe-60d946f3bd1e service nova] Acquiring lock "refresh_cache-2fc7eecf-a7a9-410b-83d4-1cb15542aea2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-81225704-1efb-4f69-8c4a-2bfc87ea1581 req-1c10a7d0-1ca6-483b-bebe-60d946f3bd1e service nova] Acquired lock "refresh_cache-2fc7eecf-a7a9-410b-83d4-1cb15542aea2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG nova.network.neutron [req-81225704-1efb-4f69-8c4a-2bfc87ea1581 req-1c10a7d0-1ca6-483b-bebe-60d946f3bd1e service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Refreshing network info cache for port ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Instance spawned successfully.
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:33:45 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:33:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb1cbc9-8bc8-4958-8c4b-b38aae8733e0]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG os_brick.utils [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:33:45 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Updating existing volume attachment record: 6f444021-4ed0-429b-ba61-0bc60f1ec092 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:33:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:33:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:33:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:33:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:33:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:33:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:33:46 user nova-compute[75018]: INFO nova.compute.manager [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Took 6.81 seconds to spawn the instance on the hypervisor.
Nov 07 15:33:46 user nova-compute[75018]: DEBUG nova.compute.manager [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:33:46 user nova-compute[75018]: INFO nova.compute.manager [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Took 8.56 seconds to build instance.
Nov 07 15:33:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-06b0458c-d4cd-4ae8-8533-abfc285ff8ff tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.717s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:46 user nova-compute[75018]: DEBUG nova.network.neutron [req-81225704-1efb-4f69-8c4a-2bfc87ea1581 req-1c10a7d0-1ca6-483b-bebe-60d946f3bd1e service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Updated VIF entry in instance network info cache for port ecda3b03-86ac-4e5f-a1b1-d28806f2512a. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:33:46 user nova-compute[75018]: DEBUG nova.network.neutron [req-81225704-1efb-4f69-8c4a-2bfc87ea1581 req-1c10a7d0-1ca6-483b-bebe-60d946f3bd1e service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Updating instance_info_cache with network_info: [{"id": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "address": "fa:16:3e:8b:ff:20", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda3b03-86", "ovs_interfaceid": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:33:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-81225704-1efb-4f69-8c4a-2bfc87ea1581 req-1c10a7d0-1ca6-483b-bebe-60d946f3bd1e service nova] Releasing lock "refresh_cache-2fc7eecf-a7a9-410b-83d4-1cb15542aea2" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:33:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:33:54 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Creating image(s)
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Did not create local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Ensure instance console log exists: /opt/stack/data/nova/instances/6fb123ab-d591-4bdc-adb0-1bf924a46db2/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Start _get_guest_xml network_info=[{"id": "f9787286-327a-418d-9ec0-961d70e33a5e", "address": "fa:16:3e:e5:e2:31", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9787286-32", "ovs_interfaceid": "f9787286-327a-418d-9ec0-961d70e33a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcRnWjHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6fb123ab-d591-4bdc-adb0-1bf924a46db2', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2694db9-6c2d-4ab8-b54a-5a1df08a1065', 'serial': 'b2694db9-6c2d-4ab8-b54a-5a1df08a1065'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'cde9fe60-6e1b-4720-acb9-c602d781c6c0', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:33:54 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:33:54 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcRnWjHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:33:54 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:33:54 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:33:54 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:33:54 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:33:54 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9d741e-796d-4a21-a615-b8f34d585eef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:33:54 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[063482d4-0991-422e-a4f3-b94959ed7535]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065] added
Nov 07 15:33:54 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eca9b3-7345-4996-a35b-95a0fc91477f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[23067a7e-c0a3-491b-84ef-37326ce840cd]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JcRnWjHr {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JcRnWjHr" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4c9721-5230-4949-a933-37a767548b39]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JcRnWjHr'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[844fbc28-7f27-4621-8d6e-05117d09c9eb]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d453c0e-00d9-45bd-920a-706ee474f476]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:33:54 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:33:54 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:33:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7989487d-2dad-4610-8114-81ee68282239]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065, portal: 172.16.0.220,3260]
Nov 07 15:33:55 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065, portal: 172.16.0.220,3260] successful.
Nov 07 15:33:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6676fde-74e7-4038-b3a4-ba33fae2c4fd]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3db038f-90be-4d66-96d7-2cd41ee4e613]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:33:55 user nova-compute[75018]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 (non-flash)
Nov 07 15:33:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:33:55 user nova-compute[75018]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 (non-flash)
Nov 07 15:33:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a0ef00-01f6-4d45-83fd-b66e4cc12431]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcRnWjHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:33:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.486s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] <== connect_volume: return (1487ms) {'type': 'block', 'scsi_wwn': '23735313134636139', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735313134636139', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-205564442',display_name='tempest-TestVolumeBootPattern-server-205564442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-205564442',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772e759d9a1d4d18ae43f53c731f87f2',ramdisk_id='',reservation_id='r-7x6yugkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1644595019',owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:33:21Z,user_data=None,user_id='3ae23950e1e84c9693f8098c270ecb55',uuid=6fb123ab-d591-4bdc-adb0-1bf924a46db2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9787286-327a-418d-9ec0-961d70e33a5e", "address": "fa:16:3e:e5:e2:31", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9787286-32", "ovs_interfaceid": "f9787286-327a-418d-9ec0-961d70e33a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converting VIF {"id": "f9787286-327a-418d-9ec0-961d70e33a5e", "address": "fa:16:3e:e5:e2:31", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9787286-32", "ovs_interfaceid": "f9787286-327a-418d-9ec0-961d70e33a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e2:31,bridge_name='br-int',has_traffic_filtering=True,id=f9787286-327a-418d-9ec0-961d70e33a5e,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9787286-32') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG nova.objects.instance [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fb123ab-d591-4bdc-adb0-1bf924a46db2 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:33:56 user nova-compute[75018]:   <uuid>6fb123ab-d591-4bdc-adb0-1bf924a46db2</uuid>
Nov 07 15:33:56 user nova-compute[75018]:   <name>instance-00000019</name>
Nov 07 15:33:56 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:33:56 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:33:56 user nova-compute[75018]:   <metadata>
Nov 07 15:33:56 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:33:56 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:33:56 user nova-compute[75018]:       <nova:name>tempest-TestVolumeBootPattern-server-205564442</nova:name>
Nov 07 15:33:56 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:33:54</nova:creationTime>
Nov 07 15:33:56 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:33:56 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:33:56 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:33:56 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:33:56 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:33:56 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:33:56 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:33:56 user nova-compute[75018]:       <nova:owner>
Nov 07 15:33:56 user nova-compute[75018]:         <nova:user uuid="3ae23950e1e84c9693f8098c270ecb55">tempest-TestVolumeBootPattern-1644595019-project-member</nova:user>
Nov 07 15:33:56 user nova-compute[75018]:         <nova:project uuid="772e759d9a1d4d18ae43f53c731f87f2">tempest-TestVolumeBootPattern-1644595019</nova:project>
Nov 07 15:33:56 user nova-compute[75018]:       </nova:owner>
Nov 07 15:33:56 user nova-compute[75018]:       <nova:ports>
Nov 07 15:33:56 user nova-compute[75018]:         <nova:port uuid="f9787286-327a-418d-9ec0-961d70e33a5e">
Nov 07 15:33:56 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 07 15:33:56 user nova-compute[75018]:         </nova:port>
Nov 07 15:33:56 user nova-compute[75018]:       </nova:ports>
Nov 07 15:33:56 user nova-compute[75018]:     </nova:instance>
Nov 07 15:33:56 user nova-compute[75018]:   </metadata>
Nov 07 15:33:56 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:33:56 user nova-compute[75018]:     <system>
Nov 07 15:33:56 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:33:56 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:33:56 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:33:56 user nova-compute[75018]:       <entry name="serial">6fb123ab-d591-4bdc-adb0-1bf924a46db2</entry>
Nov 07 15:33:56 user nova-compute[75018]:       <entry name="uuid">6fb123ab-d591-4bdc-adb0-1bf924a46db2</entry>
Nov 07 15:33:56 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:33:56 user nova-compute[75018]:     </system>
Nov 07 15:33:56 user nova-compute[75018]:   </sysinfo>
Nov 07 15:33:56 user nova-compute[75018]:   <os>
Nov 07 15:33:56 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:33:56 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:33:56 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:33:56 user nova-compute[75018]:   </os>
Nov 07 15:33:56 user nova-compute[75018]:   <features>
Nov 07 15:33:56 user nova-compute[75018]:     <acpi/>
Nov 07 15:33:56 user nova-compute[75018]:     <apic/>
Nov 07 15:33:56 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:33:56 user nova-compute[75018]:   </features>
Nov 07 15:33:56 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:33:56 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:33:56 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:33:56 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:33:56 user nova-compute[75018]:   </clock>
Nov 07 15:33:56 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:33:56 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:33:56 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:33:56 user nova-compute[75018]:   </cpu>
Nov 07 15:33:56 user nova-compute[75018]:   <devices>
Nov 07 15:33:56 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:33:56 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:33:56 user nova-compute[75018]:       <source dev="/dev/sdc"/>
Nov 07 15:33:56 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:33:56 user nova-compute[75018]:       <serial>b2694db9-6c2d-4ab8-b54a-5a1df08a1065</serial>
Nov 07 15:33:56 user nova-compute[75018]:     </disk>
Nov 07 15:33:56 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:33:56 user nova-compute[75018]:       <mac address="fa:16:3e:e5:e2:31"/>
Nov 07 15:33:56 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:33:56 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:33:56 user nova-compute[75018]:       <target dev="tapf9787286-32"/>
Nov 07 15:33:56 user nova-compute[75018]:     </interface>
Nov 07 15:33:56 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:33:56 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/6fb123ab-d591-4bdc-adb0-1bf924a46db2/console.log" append="off"/>
Nov 07 15:33:56 user nova-compute[75018]:     </serial>
Nov 07 15:33:56 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:33:56 user nova-compute[75018]:     <video>
Nov 07 15:33:56 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:33:56 user nova-compute[75018]:     </video>
Nov 07 15:33:56 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:33:56 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:33:56 user nova-compute[75018]:     </rng>
Nov 07 15:33:56 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:33:56 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:33:56 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:33:56 user nova-compute[75018]:     </memballoon>
Nov 07 15:33:56 user nova-compute[75018]:   </devices>
Nov 07 15:33:56 user nova-compute[75018]: </domain>
Nov 07 15:33:56 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-205564442',display_name='tempest-TestVolumeBootPattern-server-205564442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-205564442',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772e759d9a1d4d18ae43f53c731f87f2',ramdisk_id='',reservation_id='r-7x6yugkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1644595019',owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:33:21Z,user_data=None,user_id='3ae23950e1e84c9693f8098c270ecb55',uuid=6fb123ab-d591-4bdc-adb0-1bf924a46db2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9787286-327a-418d-9ec0-961d70e33a5e", "address": "fa:16:3e:e5:e2:31", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9787286-32", "ovs_interfaceid": "f9787286-327a-418d-9ec0-961d70e33a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converting VIF {"id": "f9787286-327a-418d-9ec0-961d70e33a5e", "address": "fa:16:3e:e5:e2:31", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9787286-32", "ovs_interfaceid": "f9787286-327a-418d-9ec0-961d70e33a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e2:31,bridge_name='br-int',has_traffic_filtering=True,id=f9787286-327a-418d-9ec0-961d70e33a5e,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9787286-32') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG os_vif [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e2:31,bridge_name='br-int',has_traffic_filtering=True,id=f9787286-327a-418d-9ec0-961d70e33a5e,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9787286-32') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c33c54e7-5c7b-5d2f-9e2d-006ec3dc2328', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9787286-32, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9787286-32, col_values=(('qos', UUID('55d77134-cd28-4e9c-9af0-8b57eaa5df1c')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9787286-32, col_values=(('external_ids', {'iface-id': 'f9787286-327a-418d-9ec0-961d70e33a5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:e2:31', 'vm-uuid': '6fb123ab-d591-4bdc-adb0-1bf924a46db2'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:56 user nova-compute[75018]: INFO os_vif [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e2:31,bridge_name='br-int',has_traffic_filtering=True,id=f9787286-327a-418d-9ec0-961d70e33a5e,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9787286-32')
Nov 07 15:33:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:33:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] No VIF found with MAC fa:16:3e:e5:e2:31, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:33:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-2ca8321e-16db-4fa7-a6d6-2f36bc00bb87 req-b613fc5a-9983-453f-a55a-decb30121e4e service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Received event network-vif-plugged-f9787286-327a-418d-9ec0-961d70e33a5e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:33:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2ca8321e-16db-4fa7-a6d6-2f36bc00bb87 req-b613fc5a-9983-453f-a55a-decb30121e4e service nova] Acquiring lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:33:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2ca8321e-16db-4fa7-a6d6-2f36bc00bb87 req-b613fc5a-9983-453f-a55a-decb30121e4e service nova] Lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:33:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2ca8321e-16db-4fa7-a6d6-2f36bc00bb87 req-b613fc5a-9983-453f-a55a-decb30121e4e service nova] Lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:33:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-2ca8321e-16db-4fa7-a6d6-2f36bc00bb87 req-b613fc5a-9983-453f-a55a-decb30121e4e service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] No waiting events found dispatching network-vif-plugged-f9787286-327a-418d-9ec0-961d70e33a5e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:33:58 user nova-compute[75018]: WARNING nova.compute.manager [req-2ca8321e-16db-4fa7-a6d6-2f36bc00bb87 req-b613fc5a-9983-453f-a55a-decb30121e4e service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Received unexpected event network-vif-plugged-f9787286-327a-418d-9ec0-961d70e33a5e for instance with vm_state building and task_state spawning.
Nov 07 15:33:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:33:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-0a43ffe8-ebfe-4d06-b4cc-cb46a423b4ed req-68080973-43f6-4390-9a32-02e1dea5ebae service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Received event network-vif-plugged-f9787286-327a-418d-9ec0-961d70e33a5e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:34:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0a43ffe8-ebfe-4d06-b4cc-cb46a423b4ed req-68080973-43f6-4390-9a32-02e1dea5ebae service nova] Acquiring lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0a43ffe8-ebfe-4d06-b4cc-cb46a423b4ed req-68080973-43f6-4390-9a32-02e1dea5ebae service nova] Lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0a43ffe8-ebfe-4d06-b4cc-cb46a423b4ed req-68080973-43f6-4390-9a32-02e1dea5ebae service nova] Lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-0a43ffe8-ebfe-4d06-b4cc-cb46a423b4ed req-68080973-43f6-4390-9a32-02e1dea5ebae service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] No waiting events found dispatching network-vif-plugged-f9787286-327a-418d-9ec0-961d70e33a5e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:34:00 user nova-compute[75018]: WARNING nova.compute.manager [req-0a43ffe8-ebfe-4d06-b4cc-cb46a423b4ed req-68080973-43f6-4390-9a32-02e1dea5ebae service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Received unexpected event network-vif-plugged-f9787286-327a-418d-9ec0-961d70e33a5e for instance with vm_state building and task_state spawning.
Nov 07 15:34:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:34:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:34:00 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Instance spawned successfully.
Nov 07 15:34:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:34:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:34:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:34:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:34:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:34:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:34:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:34:00 user nova-compute[75018]: INFO nova.compute.manager [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 07 15:34:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:34:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:00 user nova-compute[75018]: INFO nova.compute.manager [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Took 40.17 seconds to build instance.
Nov 07 15:34:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4f471d29-c800-4843-8130-a75868531da3 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.276s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "fa9e2a83-4f50-446b-a5d0-3caaca251953" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "fa9e2a83-4f50-446b-a5d0-3caaca251953" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:16 user nova-compute[75018]: INFO nova.compute.manager [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Terminating instance
Nov 07 15:34:16 user nova-compute[75018]: DEBUG nova.compute.manager [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-47bb9a60-21f1-4644-8391-03c33d8bdb44 req-7b456c06-3032-4d99-a87d-da2225f9c623 service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Received event network-vif-unplugged-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-47bb9a60-21f1-4644-8391-03c33d8bdb44 req-7b456c06-3032-4d99-a87d-da2225f9c623 service nova] Acquiring lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-47bb9a60-21f1-4644-8391-03c33d8bdb44 req-7b456c06-3032-4d99-a87d-da2225f9c623 service nova] Lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-47bb9a60-21f1-4644-8391-03c33d8bdb44 req-7b456c06-3032-4d99-a87d-da2225f9c623 service nova] Lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-47bb9a60-21f1-4644-8391-03c33d8bdb44 req-7b456c06-3032-4d99-a87d-da2225f9c623 service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] No waiting events found dispatching network-vif-unplugged-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-47bb9a60-21f1-4644-8391-03c33d8bdb44 req-7b456c06-3032-4d99-a87d-da2225f9c623 service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Received event network-vif-unplugged-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:34:16 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Instance destroyed successfully.
Nov 07 15:34:16 user nova-compute[75018]: DEBUG nova.objects.instance [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lazy-loading 'resources' on Instance uuid fa9e2a83-4f50-446b-a5d0-3caaca251953 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-820068457',display_name='tempest-VolumesActionsTest-instance-820068457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-820068457',id=24,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:32:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4f5f1be50a349608f65cc66956cce7d',ramdisk_id='',reservation_id='r-093ji38a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1647501759',owner_user_name='tempest-VolumesActionsTest-1647501759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:32:33Z,user_data=None,user_id='6258fd6050d241f49713a0a788f79aa0',uuid=fa9e2a83-4f50-446b-a5d0-3caaca251953,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "address": "fa:16:3e:62:82:e6", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6aa7d3-a7", "ovs_interfaceid": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Converting VIF {"id": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "address": "fa:16:3e:62:82:e6", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6aa7d3-a7", "ovs_interfaceid": "5f6aa7d3-a731-4027-9af1-79cc39b1bdd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=5f6aa7d3-a731-4027-9af1-79cc39b1bdd5,network=Network(9c06cf86-20ca-42bb-b009-18115bbbc97d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6aa7d3-a7') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG os_vif [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=5f6aa7d3-a731-4027-9af1-79cc39b1bdd5,network=Network(9c06cf86-20ca-42bb-b009-18115bbbc97d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6aa7d3-a7') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f6aa7d3-a7, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b89388d2-dae6-485f-8423-0709f0f06c5e) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:16 user nova-compute[75018]: INFO os_vif [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=5f6aa7d3-a731-4027-9af1-79cc39b1bdd5,network=Network(9c06cf86-20ca-42bb-b009-18115bbbc97d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6aa7d3-a7')
Nov 07 15:34:16 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Deleting instance files /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953_del
Nov 07 15:34:16 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Deletion of /opt/stack/data/nova/instances/fa9e2a83-4f50-446b-a5d0-3caaca251953_del complete
Nov 07 15:34:16 user nova-compute[75018]: INFO nova.compute.manager [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 07 15:34:16 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:34:16 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:34:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:17 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:34:17 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Took 0.54 seconds to deallocate network for instance.
Nov 07 15:34:17 user nova-compute[75018]: DEBUG nova.compute.manager [req-9792879c-fda9-4b44-921b-a94db0ab32fa req-19e50519-b64b-46f0-a517-0a4cd87e9822 service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Received event network-vif-deleted-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:34:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:17 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:34:17 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:34:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:17 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Deleted allocations for instance fa9e2a83-4f50-446b-a5d0-3caaca251953
Nov 07 15:34:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-82595106-546a-4b0b-8934-cfab9a537501 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "fa9e2a83-4f50-446b-a5d0-3caaca251953" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.995s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-ee34eee4-c624-4b68-aa5c-a13858e9a280 req-43ba75d4-fa3a-4a21-820d-a1c3bd578171 service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Received event network-vif-plugged-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:34:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ee34eee4-c624-4b68-aa5c-a13858e9a280 req-43ba75d4-fa3a-4a21-820d-a1c3bd578171 service nova] Acquiring lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ee34eee4-c624-4b68-aa5c-a13858e9a280 req-43ba75d4-fa3a-4a21-820d-a1c3bd578171 service nova] Lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ee34eee4-c624-4b68-aa5c-a13858e9a280 req-43ba75d4-fa3a-4a21-820d-a1c3bd578171 service nova] Lock "fa9e2a83-4f50-446b-a5d0-3caaca251953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-ee34eee4-c624-4b68-aa5c-a13858e9a280 req-43ba75d4-fa3a-4a21-820d-a1c3bd578171 service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] No waiting events found dispatching network-vif-plugged-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:34:18 user nova-compute[75018]: WARNING nova.compute.manager [req-ee34eee4-c624-4b68-aa5c-a13858e9a280 req-43ba75d4-fa3a-4a21-820d-a1c3bd578171 service nova] [instance: fa9e2a83-4f50-446b-a5d0-3caaca251953] Received unexpected event network-vif-plugged-5f6aa7d3-a731-4027-9af1-79cc39b1bdd5 for instance with vm_state deleted and task_state None.
Nov 07 15:34:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:26 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:34:26 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:34:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:27 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:34:27 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:28 user nova-compute[75018]: INFO nova.compute.manager [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Terminating instance
Nov 07 15:34:28 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-8e5781de-a7fc-4bed-b140-2730ba03dcc1 req-c95448aa-ce4d-4780-95b5-e61e6b873a54 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-vif-unplugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8e5781de-a7fc-4bed-b140-2730ba03dcc1 req-c95448aa-ce4d-4780-95b5-e61e6b873a54 service nova] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8e5781de-a7fc-4bed-b140-2730ba03dcc1 req-c95448aa-ce4d-4780-95b5-e61e6b873a54 service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8e5781de-a7fc-4bed-b140-2730ba03dcc1 req-c95448aa-ce4d-4780-95b5-e61e6b873a54 service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-8e5781de-a7fc-4bed-b140-2730ba03dcc1 req-c95448aa-ce4d-4780-95b5-e61e6b873a54 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] No waiting events found dispatching network-vif-unplugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-8e5781de-a7fc-4bed-b140-2730ba03dcc1 req-c95448aa-ce4d-4780-95b5-e61e6b873a54 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-vif-unplugged-1a222150-39b6-4eb8-8502-379bd9f9f468 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:34:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Instance destroyed successfully.
Nov 07 15:34:28 user nova-compute[75018]: DEBUG nova.objects.instance [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lazy-loading 'resources' on Instance uuid ca4ef7a3-718c-40c0-a2e0-bb636fc2214d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T15:28:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-69325560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-69325560',id=19,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaOv2W2tLVLZXeJouTLzkDUUJ5/sVjsATl2Nzga1jOlwbQ4D+LsMnHpvBFVTtTOkra++qIzs0qRkNi3BAnUQDH52yljVA+1NpUjMXRdcnhtKUGecCiOuRrqaFwZkBSrIA==',key_name='tempest-keypair-685240993',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1d8e2c039d94beea94f85d8d5a95d95',ramdisk_id='',reservation_id='r-n25mco0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-175335890',owner_user_name='tempest-AttachVolumeShelveTestJSON-175335890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:32:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c7596f1e0e748728fa459908f89aede',uuid=ca4ef7a3-718c-40c0-a2e0-bb636fc2214d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converting VIF {"id": "1a222150-39b6-4eb8-8502-379bd9f9f468", "address": "fa:16:3e:9d:62:d5", "network": {"id": "16211f68-822a-48d6-a6a8-6f7fd882ec34", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-396277927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d8e2c039d94beea94f85d8d5a95d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a222150-39", "ovs_interfaceid": "1a222150-39b6-4eb8-8502-379bd9f9f468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:62:d5,bridge_name='br-int',has_traffic_filtering=True,id=1a222150-39b6-4eb8-8502-379bd9f9f468,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a222150-39') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG os_vif [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:62:d5,bridge_name='br-int',has_traffic_filtering=True,id=1a222150-39b6-4eb8-8502-379bd9f9f468,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a222150-39') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a222150-39, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cbe6b0f-d017-4bd6-a7df-2b20c3a3304f) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:34:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:34:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:29 user nova-compute[75018]: INFO os_vif [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:62:d5,bridge_name='br-int',has_traffic_filtering=True,id=1a222150-39b6-4eb8-8502-379bd9f9f468,network=Network(16211f68-822a-48d6-a6a8-6f7fd882ec34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a222150-39')
Nov 07 15:34:29 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Deleting instance files /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d_del
Nov 07 15:34:29 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Deletion of /opt/stack/data/nova/instances/ca4ef7a3-718c-40c0-a2e0-bb636fc2214d_del complete
Nov 07 15:34:29 user nova-compute[75018]: INFO nova.compute.manager [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 07 15:34:29 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:34:29 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:34:29 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:34:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:34:30 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:34:30 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Took 0.93 seconds to deallocate network for instance.
Nov 07 15:34:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-76355ced-ac3e-41f5-af43-a86b9f5b96e5 req-cfab5e4d-7160-4c9d-ab10-1c2255ad39d4 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-vif-deleted-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:34:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:30 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:34:30 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:34:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-f298d68e-276e-454f-b42c-21eeea35ad21 req-62953e21-5842-42a5-a78d-4740b3dd4a83 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:34:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f298d68e-276e-454f-b42c-21eeea35ad21 req-62953e21-5842-42a5-a78d-4740b3dd4a83 service nova] Acquiring lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f298d68e-276e-454f-b42c-21eeea35ad21 req-62953e21-5842-42a5-a78d-4740b3dd4a83 service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f298d68e-276e-454f-b42c-21eeea35ad21 req-62953e21-5842-42a5-a78d-4740b3dd4a83 service nova] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-f298d68e-276e-454f-b42c-21eeea35ad21 req-62953e21-5842-42a5-a78d-4740b3dd4a83 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] No waiting events found dispatching network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:34:30 user nova-compute[75018]: WARNING nova.compute.manager [req-f298d68e-276e-454f-b42c-21eeea35ad21 req-62953e21-5842-42a5-a78d-4740b3dd4a83 service nova] [instance: ca4ef7a3-718c-40c0-a2e0-bb636fc2214d] Received unexpected event network-vif-plugged-1a222150-39b6-4eb8-8502-379bd9f9f468 for instance with vm_state deleted and task_state None.
Nov 07 15:34:30 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Deleted allocations for instance ca4ef7a3-718c-40c0-a2e0-bb636fc2214d
Nov 07 15:34:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5ed661ba-6f3f-4e98-ba91-7cc1fe80d3da tempest-AttachVolumeShelveTestJSON-175335890 tempest-AttachVolumeShelveTestJSON-175335890-project-member] Lock "ca4ef7a3-718c-40c0-a2e0-bb636fc2214d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.509s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsxmwBvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:34:31 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:34:31 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:34:31 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c60527b-88b0-4c34-9336-d373cc3268f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:34:31 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b136858-8b29-40f6-8bd4-0ada1bcacba5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12] added
Nov 07 15:34:31 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[25098fe6-9dcc-409f-9015-47b46ec37995]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e243c1f-3d3e-494f-9dc1-e01da9169926]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsxmwBvV {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsxmwBvV" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc3d170-3e35-4d52-8b51-e7f53c3cff3c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EsxmwBvV'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b63be2-37a3-4a76-a18f-eb6730c9a90c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d52da8d-551d-4535-ab5e-9f34ea6d19e9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:34:31 user nova-compute[75018]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 (non-flash)
Nov 07 15:34:31 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:34:31 user nova-compute[75018]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 (non-flash)
Nov 07 15:34:31 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2fb077-26f2-4b60-be30-a05b2540362e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12, portal: 172.16.0.220,3260]
Nov 07 15:34:31 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12, portal: 172.16.0.220,3260] successful.
Nov 07 15:34:31 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76fb83c-3ba1-48df-b0ad-bedb7ae8d730]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[891388bf-bd9a-4f57-b041-ab27fd6a541d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:34:31 user nova-compute[75018]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 (non-flash)
Nov 07 15:34:31 user nova-compute[75018]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 (non-flash)
Nov 07 15:34:31 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:34:31 user nova-compute[75018]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 (non-flash)
Nov 07 15:34:31 user nova-compute[75018]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 (non-flash)
Nov 07 15:34:31 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4f69ef-93ce-46b7-a9a4-2b39a82dfa99]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsxmwBvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:34:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:34:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:34:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23665653334646332', 'path': '/dev/sdd'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:34:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665653334646332', 'path': '/dev/sdd'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:34:32 user nova-compute[75018]: DEBUG nova.objects.instance [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lazy-loading 'flavor' on Instance uuid 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:34:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:34:32 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:34:32 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:34:32 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:34:32 user nova-compute[75018]:   <serial>114ee768-b3d6-48c2-9e59-cda69f9f8d12</serial>
Nov 07 15:34:32 user nova-compute[75018]: </disk>
Nov 07 15:34:32 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:34:32 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:34:32 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:34:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:34:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:34:32 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:34:32 user nova-compute[75018]: INFO nova.compute.manager [None req-afc77e21-8eb6-4fb2-8fe6-b6172807a17a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Unrescuing
Nov 07 15:34:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-afc77e21-8eb6-4fb2-8fe6-b6172807a17a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] No VIF found with MAC fa:16:3e:8b:ff:20, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-33b31a58-9373-4e93-9a01-ca190760d77d tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.496s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Updating instance_info_cache with network_info: [{"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-afc77e21-8eb6-4fb2-8fe6-b6172807a17a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquired lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG nova.network.neutron [None req-afc77e21-8eb6-4fb2-8fe6-b6172807a17a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG nova.network.neutron [None req-afc77e21-8eb6-4fb2-8fe6-b6172807a17a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Updating instance_info_cache with network_info: [{"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-afc77e21-8eb6-4fb2-8fe6-b6172807a17a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Releasing lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG nova.objects.instance [None req-afc77e21-8eb6-4fb2-8fe6-b6172807a17a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'flavor' on Instance uuid 626a4817-31f4-48c8-9ab6-07d539dd0a14 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-43474709-86db-4a82-a3ed-c69262109147 req-d2072bee-07dc-4d67-b89a-7c4263c6333a service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-vif-unplugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-43474709-86db-4a82-a3ed-c69262109147 req-d2072bee-07dc-4d67-b89a-7c4263c6333a service nova] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-43474709-86db-4a82-a3ed-c69262109147 req-d2072bee-07dc-4d67-b89a-7c4263c6333a service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-43474709-86db-4a82-a3ed-c69262109147 req-d2072bee-07dc-4d67-b89a-7c4263c6333a service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-43474709-86db-4a82-a3ed-c69262109147 req-d2072bee-07dc-4d67-b89a-7c4263c6333a service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] No waiting events found dispatching network-vif-unplugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:34:33 user nova-compute[75018]: WARNING nova.compute.manager [req-43474709-86db-4a82-a3ed-c69262109147 req-d2072bee-07dc-4d67-b89a-7c4263c6333a service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received unexpected event network-vif-unplugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:34:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:34 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Instance destroyed successfully.
Nov 07 15:34:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:35 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:34:35 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:34:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:35 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:34:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] No waiting events found dispatching network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:34:36 user nova-compute[75018]: WARNING nova.compute.manager [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received unexpected event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:34:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] No waiting events found dispatching network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:34:36 user nova-compute[75018]: WARNING nova.compute.manager [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received unexpected event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:34:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] No waiting events found dispatching network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:34:36 user nova-compute[75018]: WARNING nova.compute.manager [req-5ac94897-2e0a-4aaf-87b3-c4780d0f93eb req-3a604a94-578e-4417-adfd-546228b4d941 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received unexpected event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG nova.compute.manager [None req-afc77e21-8eb6-4fb2-8fe6-b6172807a17a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:34:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:34:40 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:34:40 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7597MB free_disk=25.117427825927734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance af83bfa8-3661-4456-8854-f6c457e149fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 31e90a00-c2df-493c-9b7e-12d3063b877f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 6fb123ab-d591-4bdc-adb0-1bf924a46db2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:34:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:41 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:34:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:34:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "fd9de68b-2c19-498a-866d-f68848b2c5c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "fd9de68b-2c19-498a-866d-f68848b2c5c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:07 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:35:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:07 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:35:07 user nova-compute[75018]: INFO nova.compute.claims [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Claim successful on node user
Nov 07 15:35:08 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:35:08 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:35:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:08 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:35:08 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:35:08 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:35:08 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:35:08 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:35:08 user nova-compute[75018]: DEBUG nova.policy [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6258fd6050d241f49713a0a788f79aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f5f1be50a349608f65cc66956cce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:35:08 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:35:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:35:08 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Creating image(s)
Nov 07 15:35:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "/opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "/opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.192s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.197s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk 1073741824" returned: 0 in 0.078s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Successfully created port: 19eb661e-ec41-4241-b20b-c19787e62999 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.252s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Cannot resize image /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Ensure instance console log exists: /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Successfully updated port: 19eb661e-ec41-4241-b20b-c19787e62999 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "refresh_cache-fd9de68b-2c19-498a-866d-f68848b2c5c7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquired lock "refresh_cache-fd9de68b-2c19-498a-866d-f68848b2c5c7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-16b9bfa7-aea2-43c6-97da-c2add34675f5 req-3223acb0-2d1d-4243-b492-6afe8d94ad86 service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Received event network-changed-19eb661e-ec41-4241-b20b-c19787e62999 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-16b9bfa7-aea2-43c6-97da-c2add34675f5 req-3223acb0-2d1d-4243-b492-6afe8d94ad86 service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Refreshing instance network info cache due to event network-changed-19eb661e-ec41-4241-b20b-c19787e62999. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-16b9bfa7-aea2-43c6-97da-c2add34675f5 req-3223acb0-2d1d-4243-b492-6afe8d94ad86 service nova] Acquiring lock "refresh_cache-fd9de68b-2c19-498a-866d-f68848b2c5c7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Updating instance_info_cache with network_info: [{"id": "19eb661e-ec41-4241-b20b-c19787e62999", "address": "fa:16:3e:e4:0c:57", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19eb661e-ec", "ovs_interfaceid": "19eb661e-ec41-4241-b20b-c19787e62999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Releasing lock "refresh_cache-fd9de68b-2c19-498a-866d-f68848b2c5c7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Instance network_info: |[{"id": "19eb661e-ec41-4241-b20b-c19787e62999", "address": "fa:16:3e:e4:0c:57", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19eb661e-ec", "ovs_interfaceid": "19eb661e-ec41-4241-b20b-c19787e62999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-16b9bfa7-aea2-43c6-97da-c2add34675f5 req-3223acb0-2d1d-4243-b492-6afe8d94ad86 service nova] Acquired lock "refresh_cache-fd9de68b-2c19-498a-866d-f68848b2c5c7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG nova.network.neutron [req-16b9bfa7-aea2-43c6-97da-c2add34675f5 req-3223acb0-2d1d-4243-b492-6afe8d94ad86 service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Refreshing network info cache for port 19eb661e-ec41-4241-b20b-c19787e62999 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:35:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Start _get_guest_xml network_info=[{"id": "19eb661e-ec41-4241-b20b-c19787e62999", "address": "fa:16:3e:e4:0c:57", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19eb661e-ec", "ovs_interfaceid": "19eb661e-ec41-4241-b20b-c19787e62999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:35:10 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:35:11 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-476100364',display_name='tempest-VolumesActionsTest-instance-476100364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-476100364',id=27,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4f5f1be50a349608f65cc66956cce7d',ramdisk_id='',reservation_id='r-cio0ui9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1647501759',owner_user_name='tempest-VolumesActionsTest-1647501759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:35:09Z,user_data=None,user_id='6258fd6050d241f49713a0a788f79aa0',uuid=fd9de68b-2c19-498a-866d-f68848b2c5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19eb661e-ec41-4241-b20b-c19787e62999", "address": "fa:16:3e:e4:0c:57", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19eb661e-ec", "ovs_interfaceid": "19eb661e-ec41-4241-b20b-c19787e62999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Converting VIF {"id": "19eb661e-ec41-4241-b20b-c19787e62999", "address": "fa:16:3e:e4:0c:57", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19eb661e-ec", "ovs_interfaceid": "19eb661e-ec41-4241-b20b-c19787e62999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0c:57,bridge_name='br-int',has_traffic_filtering=True,id=19eb661e-ec41-4241-b20b-c19787e62999,network=Network(9c06cf86-20ca-42bb-b009-18115bbbc97d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19eb661e-ec') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.objects.instance [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lazy-loading 'pci_devices' on Instance uuid fd9de68b-2c19-498a-866d-f68848b2c5c7 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:35:11 user nova-compute[75018]:   <uuid>fd9de68b-2c19-498a-866d-f68848b2c5c7</uuid>
Nov 07 15:35:11 user nova-compute[75018]:   <name>instance-0000001b</name>
Nov 07 15:35:11 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:35:11 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:35:11 user nova-compute[75018]:   <metadata>
Nov 07 15:35:11 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:35:11 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:35:11 user nova-compute[75018]:       <nova:name>tempest-VolumesActionsTest-instance-476100364</nova:name>
Nov 07 15:35:11 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:35:11</nova:creationTime>
Nov 07 15:35:11 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:35:11 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:35:11 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:35:11 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:35:11 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:35:11 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:35:11 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:35:11 user nova-compute[75018]:       <nova:owner>
Nov 07 15:35:11 user nova-compute[75018]:         <nova:user uuid="6258fd6050d241f49713a0a788f79aa0">tempest-VolumesActionsTest-1647501759-project-member</nova:user>
Nov 07 15:35:11 user nova-compute[75018]:         <nova:project uuid="c4f5f1be50a349608f65cc66956cce7d">tempest-VolumesActionsTest-1647501759</nova:project>
Nov 07 15:35:11 user nova-compute[75018]:       </nova:owner>
Nov 07 15:35:11 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:35:11 user nova-compute[75018]:       <nova:ports>
Nov 07 15:35:11 user nova-compute[75018]:         <nova:port uuid="19eb661e-ec41-4241-b20b-c19787e62999">
Nov 07 15:35:11 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 15:35:11 user nova-compute[75018]:         </nova:port>
Nov 07 15:35:11 user nova-compute[75018]:       </nova:ports>
Nov 07 15:35:11 user nova-compute[75018]:     </nova:instance>
Nov 07 15:35:11 user nova-compute[75018]:   </metadata>
Nov 07 15:35:11 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:35:11 user nova-compute[75018]:     <system>
Nov 07 15:35:11 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:35:11 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:35:11 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:35:11 user nova-compute[75018]:       <entry name="serial">fd9de68b-2c19-498a-866d-f68848b2c5c7</entry>
Nov 07 15:35:11 user nova-compute[75018]:       <entry name="uuid">fd9de68b-2c19-498a-866d-f68848b2c5c7</entry>
Nov 07 15:35:11 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:35:11 user nova-compute[75018]:     </system>
Nov 07 15:35:11 user nova-compute[75018]:   </sysinfo>
Nov 07 15:35:11 user nova-compute[75018]:   <os>
Nov 07 15:35:11 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:35:11 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:35:11 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:35:11 user nova-compute[75018]:   </os>
Nov 07 15:35:11 user nova-compute[75018]:   <features>
Nov 07 15:35:11 user nova-compute[75018]:     <acpi/>
Nov 07 15:35:11 user nova-compute[75018]:     <apic/>
Nov 07 15:35:11 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:35:11 user nova-compute[75018]:   </features>
Nov 07 15:35:11 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:35:11 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:35:11 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:35:11 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:35:11 user nova-compute[75018]:   </clock>
Nov 07 15:35:11 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:35:11 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:35:11 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:35:11 user nova-compute[75018]:   </cpu>
Nov 07 15:35:11 user nova-compute[75018]:   <devices>
Nov 07 15:35:11 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:35:11 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:35:11 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk"/>
Nov 07 15:35:11 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:35:11 user nova-compute[75018]:     </disk>
Nov 07 15:35:11 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:35:11 user nova-compute[75018]:       <mac address="fa:16:3e:e4:0c:57"/>
Nov 07 15:35:11 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:35:11 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:35:11 user nova-compute[75018]:       <target dev="tap19eb661e-ec"/>
Nov 07 15:35:11 user nova-compute[75018]:     </interface>
Nov 07 15:35:11 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:35:11 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/console.log" append="off"/>
Nov 07 15:35:11 user nova-compute[75018]:     </serial>
Nov 07 15:35:11 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:35:11 user nova-compute[75018]:     <video>
Nov 07 15:35:11 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:35:11 user nova-compute[75018]:     </video>
Nov 07 15:35:11 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:35:11 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:35:11 user nova-compute[75018]:     </rng>
Nov 07 15:35:11 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:35:11 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:35:11 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:35:11 user nova-compute[75018]:     </memballoon>
Nov 07 15:35:11 user nova-compute[75018]:   </devices>
Nov 07 15:35:11 user nova-compute[75018]: </domain>
Nov 07 15:35:11 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-476100364',display_name='tempest-VolumesActionsTest-instance-476100364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-476100364',id=27,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4f5f1be50a349608f65cc66956cce7d',ramdisk_id='',reservation_id='r-cio0ui9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1647501759',owner_user_name='tempest-VolumesActionsTest-1647501759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:35:09Z,user_data=None,user_id='6258fd6050d241f49713a0a788f79aa0',uuid=fd9de68b-2c19-498a-866d-f68848b2c5c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19eb661e-ec41-4241-b20b-c19787e62999", "address": "fa:16:3e:e4:0c:57", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19eb661e-ec", "ovs_interfaceid": "19eb661e-ec41-4241-b20b-c19787e62999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Converting VIF {"id": "19eb661e-ec41-4241-b20b-c19787e62999", "address": "fa:16:3e:e4:0c:57", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19eb661e-ec", "ovs_interfaceid": "19eb661e-ec41-4241-b20b-c19787e62999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0c:57,bridge_name='br-int',has_traffic_filtering=True,id=19eb661e-ec41-4241-b20b-c19787e62999,network=Network(9c06cf86-20ca-42bb-b009-18115bbbc97d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19eb661e-ec') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG os_vif [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0c:57,bridge_name='br-int',has_traffic_filtering=True,id=19eb661e-ec41-4241-b20b-c19787e62999,network=Network(9c06cf86-20ca-42bb-b009-18115bbbc97d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19eb661e-ec') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a636bb3e-8fea-5ffd-b79b-ae5da6c3eef3', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19eb661e-ec, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19eb661e-ec, col_values=(('qos', UUID('e2bc15b6-a49d-482f-a85d-a1b261e20cc8')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19eb661e-ec, col_values=(('external_ids', {'iface-id': '19eb661e-ec41-4241-b20b-c19787e62999', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:0c:57', 'vm-uuid': 'fd9de68b-2c19-498a-866d-f68848b2c5c7'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:11 user nova-compute[75018]: INFO os_vif [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0c:57,bridge_name='br-int',has_traffic_filtering=True,id=19eb661e-ec41-4241-b20b-c19787e62999,network=Network(9c06cf86-20ca-42bb-b009-18115bbbc97d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19eb661e-ec')
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] No VIF found with MAC fa:16:3e:e4:0c:57, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:11 user nova-compute[75018]: INFO nova.compute.manager [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Terminating instance
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.network.neutron [req-16b9bfa7-aea2-43c6-97da-c2add34675f5 req-3223acb0-2d1d-4243-b492-6afe8d94ad86 service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Updated VIF entry in instance network info cache for port 19eb661e-ec41-4241-b20b-c19787e62999. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.network.neutron [req-16b9bfa7-aea2-43c6-97da-c2add34675f5 req-3223acb0-2d1d-4243-b492-6afe8d94ad86 service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Updating instance_info_cache with network_info: [{"id": "19eb661e-ec41-4241-b20b-c19787e62999", "address": "fa:16:3e:e4:0c:57", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19eb661e-ec", "ovs_interfaceid": "19eb661e-ec41-4241-b20b-c19787e62999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-16b9bfa7-aea2-43c6-97da-c2add34675f5 req-3223acb0-2d1d-4243-b492-6afe8d94ad86 service nova] Releasing lock "refresh_cache-fd9de68b-2c19-498a-866d-f68848b2c5c7" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-e719c7ae-e977-44a4-987a-7c36cc72f45e req-44f10d9d-9118-4381-afd7-41e8f3848cd2 service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Received event network-vif-unplugged-f9787286-327a-418d-9ec0-961d70e33a5e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e719c7ae-e977-44a4-987a-7c36cc72f45e req-44f10d9d-9118-4381-afd7-41e8f3848cd2 service nova] Acquiring lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e719c7ae-e977-44a4-987a-7c36cc72f45e req-44f10d9d-9118-4381-afd7-41e8f3848cd2 service nova] Lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e719c7ae-e977-44a4-987a-7c36cc72f45e req-44f10d9d-9118-4381-afd7-41e8f3848cd2 service nova] Lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-e719c7ae-e977-44a4-987a-7c36cc72f45e req-44f10d9d-9118-4381-afd7-41e8f3848cd2 service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] No waiting events found dispatching network-vif-unplugged-f9787286-327a-418d-9ec0-961d70e33a5e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:35:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-e719c7ae-e977-44a4-987a-7c36cc72f45e req-44f10d9d-9118-4381-afd7-41e8f3848cd2 service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Received event network-vif-unplugged-f9787286-327a-418d-9ec0-961d70e33a5e for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:35:12 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Instance destroyed successfully.
Nov 07 15:35:12 user nova-compute[75018]: DEBUG nova.objects.instance [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lazy-loading 'resources' on Instance uuid 6fb123ab-d591-4bdc-adb0-1bf924a46db2 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-205564442',display_name='tempest-TestVolumeBootPattern-server-205564442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-205564442',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:34:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='772e759d9a1d4d18ae43f53c731f87f2',ramdisk_id='',reservation_id='r-7x6yugkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1644595019',owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:34:01Z,user_data=None,user_id='3ae23950e1e84c9693f8098c270ecb55',uuid=6fb123ab-d591-4bdc-adb0-1bf924a46db2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9787286-327a-418d-9ec0-961d70e33a5e", "address": "fa:16:3e:e5:e2:31", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9787286-32", "ovs_interfaceid": "f9787286-327a-418d-9ec0-961d70e33a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converting VIF {"id": "f9787286-327a-418d-9ec0-961d70e33a5e", "address": "fa:16:3e:e5:e2:31", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9787286-32", "ovs_interfaceid": "f9787286-327a-418d-9ec0-961d70e33a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e2:31,bridge_name='br-int',has_traffic_filtering=True,id=f9787286-327a-418d-9ec0-961d70e33a5e,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9787286-32') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG os_vif [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e2:31,bridge_name='br-int',has_traffic_filtering=True,id=f9787286-327a-418d-9ec0-961d70e33a5e,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9787286-32') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9787286-32, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55d77134-cd28-4e9c-9af0-8b57eaa5df1c) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:12 user nova-compute[75018]: INFO os_vif [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e2:31,bridge_name='br-int',has_traffic_filtering=True,id=f9787286-327a-418d-9ec0-961d70e33a5e,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9787286-32')
Nov 07 15:35:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcRnWjHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:35:12 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:35:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[493faf5f-ce99-45af-a6f0-7fe0a632a4d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:35:12 user nova-compute[75018]: No targets found.
Nov 07 15:35:12 user nova-compute[75018]: iSNS:
Nov 07 15:35:12 user nova-compute[75018]: No targets found.
Nov 07 15:35:12 user nova-compute[75018]: STATIC:
Nov 07 15:35:12 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065
Nov 07 15:35:12 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:35:12 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:35:12 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940
Nov 07 15:35:12 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:35:12 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:35:12 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12
Nov 07 15:35:12 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:35:12 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:35:12 user nova-compute[75018]: FIRMWARE:
Nov 07 15:35:12 user nova-compute[75018]: No targets found.
Nov 07 15:35:12 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:35:12 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:35:12 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62e2ded-52de-41dd-a549-498c7580d52b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2e67d1-9048-47b3-afa7-613283a52d5c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:35:12 user nova-compute[75018]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 (non-flash)
Nov 07 15:35:12 user nova-compute[75018]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 (non-flash)
Nov 07 15:35:12 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:35:12 user nova-compute[75018]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 (non-flash)
Nov 07 15:35:12 user nova-compute[75018]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 (non-flash)
Nov 07 15:35:12 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feaf81f0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065'): ({'sdc'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Removing single pathed devices sdc {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee9b2df-625d-42f0-b028-34110c2bcfce]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b4857a-42ab-4b96-a203-a0ca51cc165a]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Flushing IO for device /dev/sdc {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6181e4-62de-42b5-b88c-17d2ec971394]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:35:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.065s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4e4ff9-2b8c-4d43-ab1f-45be0b0a522b]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2707c82-863c-419f-ae83-75119c972bca]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ef0e88-8b09-4b6a-97a3-ed81c4526028]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065, portal: 172.16.0.220,3260]
Nov 07 15:35:13 user nova-compute[75018]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065, portal: 172.16.0.220,3260] successful.
Nov 07 15:35:13 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2694db9-6c2d-4ab8-b54a-5a1df08a1065 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60318a3-b469-4e64-bb0f-274563b0143f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] <== disconnect_volume: return (394ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:35:13 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Deleting instance files /opt/stack/data/nova/instances/6fb123ab-d591-4bdc-adb0-1bf924a46db2_del
Nov 07 15:35:13 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Deletion of /opt/stack/data/nova/instances/6fb123ab-d591-4bdc-adb0-1bf924a46db2_del complete
Nov 07 15:35:13 user nova-compute[75018]: INFO nova.compute.manager [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Took 1.87 seconds to destroy the instance on the hypervisor.
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Received event network-vif-plugged-f9787286-327a-418d-9ec0-961d70e33a5e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] Acquiring lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] Lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] Lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] No waiting events found dispatching network-vif-plugged-f9787286-327a-418d-9ec0-961d70e33a5e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:35:13 user nova-compute[75018]: WARNING nova.compute.manager [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Received unexpected event network-vif-plugged-f9787286-327a-418d-9ec0-961d70e33a5e for instance with vm_state active and task_state deleting.
Nov 07 15:35:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Received event network-vif-plugged-19eb661e-ec41-4241-b20b-c19787e62999 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] Acquiring lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] Lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] Lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] No waiting events found dispatching network-vif-plugged-19eb661e-ec41-4241-b20b-c19787e62999 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:35:13 user nova-compute[75018]: WARNING nova.compute.manager [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Received unexpected event network-vif-plugged-19eb661e-ec41-4241-b20b-c19787e62999 for instance with vm_state building and task_state spawning.
Nov 07 15:35:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Received event network-vif-plugged-19eb661e-ec41-4241-b20b-c19787e62999 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] Acquiring lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] Lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] Lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] No waiting events found dispatching network-vif-plugged-19eb661e-ec41-4241-b20b-c19787e62999 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:35:13 user nova-compute[75018]: WARNING nova.compute.manager [req-ff454e15-8971-4794-8da1-f618cfef6452 req-eee4cab8-d3bf-495a-9f13-938471076bdc service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Received unexpected event network-vif-plugged-19eb661e-ec41-4241-b20b-c19787e62999 for instance with vm_state building and task_state spawning.
Nov 07 15:35:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-cf458abd-242f-4b20-ae7f-6c178ec40a78 req-acc13c31-0b1a-4746-982f-c1094944c696 service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Received event network-vif-deleted-f9787286-327a-418d-9ec0-961d70e33a5e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:35:13 user nova-compute[75018]: INFO nova.compute.manager [req-cf458abd-242f-4b20-ae7f-6c178ec40a78 req-acc13c31-0b1a-4746-982f-c1094944c696 service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Neutron deleted interface f9787286-327a-418d-9ec0-961d70e33a5e; detaching it from the instance and deleting it from the info cache
Nov 07 15:35:13 user nova-compute[75018]: DEBUG nova.network.neutron [req-cf458abd-242f-4b20-ae7f-6c178ec40a78 req-acc13c31-0b1a-4746-982f-c1094944c696 service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:35:13 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Took 0.65 seconds to deallocate network for instance.
Nov 07 15:35:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-cf458abd-242f-4b20-ae7f-6c178ec40a78 req-acc13c31-0b1a-4746-982f-c1094944c696 service nova] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Detach interface failed, port_id=f9787286-327a-418d-9ec0-961d70e33a5e, reason: Instance 6fb123ab-d591-4bdc-adb0-1bf924a46db2 could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:35:14 user nova-compute[75018]: INFO nova.compute.manager [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Took 1.06 seconds to detach 1 volumes for instance.
Nov 07 15:35:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 6fb123ab-d591-4bdc-adb0-1bf924a46db2] Deleting volume: b2694db9-6c2d-4ab8-b54a-5a1df08a1065 {{(pid=75018) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:35:15 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Instance spawned successfully.
Nov 07 15:35:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.516s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:15 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Deleted allocations for instance 6fb123ab-d591-4bdc-adb0-1bf924a46db2
Nov 07 15:35:15 user nova-compute[75018]: INFO nova.compute.manager [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 07 15:35:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:35:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6e7d2391-ef29-4fd0-b154-7cde54580b75 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "6fb123ab-d591-4bdc-adb0-1bf924a46db2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.446s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:15 user nova-compute[75018]: INFO nova.compute.manager [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Took 8.02 seconds to build instance.
Nov 07 15:35:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4db02bd9-5651-4ee3-b164-d4631e73d5ab tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "fd9de68b-2c19-498a-866d-f68848b2c5c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.135s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:26 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:35:26 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:35:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:27 user nova-compute[75018]: INFO nova.compute.manager [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Terminating instance
Nov 07 15:35:27 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:35:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:35:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:35:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:35:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:35:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b4be219-66b3-4079-a403-1fc00dba4486 req-69bb3cff-3056-4789-8254-1923c91978ff service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Received event network-vif-unplugged-7a9cf4d0-ac7d-4d89-b175-c6519bb86979 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b4be219-66b3-4079-a403-1fc00dba4486 req-69bb3cff-3056-4789-8254-1923c91978ff service nova] Acquiring lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b4be219-66b3-4079-a403-1fc00dba4486 req-69bb3cff-3056-4789-8254-1923c91978ff service nova] Lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5b4be219-66b3-4079-a403-1fc00dba4486 req-69bb3cff-3056-4789-8254-1923c91978ff service nova] Lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b4be219-66b3-4079-a403-1fc00dba4486 req-69bb3cff-3056-4789-8254-1923c91978ff service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] No waiting events found dispatching network-vif-unplugged-7a9cf4d0-ac7d-4d89-b175-c6519bb86979 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-5b4be219-66b3-4079-a403-1fc00dba4486 req-69bb3cff-3056-4789-8254-1923c91978ff service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Received event network-vif-unplugged-7a9cf4d0-ac7d-4d89-b175-c6519bb86979 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:35:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Instance destroyed successfully.
Nov 07 15:35:28 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lazy-loading 'resources' on Instance uuid 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1088743790',display_name='tempest-ServersNegativeTestJSON-server-1088743790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1088743790',id=26,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:33:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aba46e41b23a4c1b93fa1e8b03715ba8',ramdisk_id='',reservation_id='r-n7jriw7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1403438128',owner_user_name='tempest-ServersNegativeTestJSON-1403438128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:33:46Z,user_data=None,user_id='6096aee5520e4cc4a9f34fdef6bae6da',uuid=2e5c462d-2ce2-4b95-816e-ac7ee26e85bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "address": "fa:16:3e:ac:2e:84", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cf4d0-ac", "ovs_interfaceid": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Converting VIF {"id": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "address": "fa:16:3e:ac:2e:84", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9cf4d0-ac", "ovs_interfaceid": "7a9cf4d0-ac7d-4d89-b175-c6519bb86979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2e:84,bridge_name='br-int',has_traffic_filtering=True,id=7a9cf4d0-ac7d-4d89-b175-c6519bb86979,network=Network(4360a01c-f5c5-4d5f-86f0-0ace428bfe0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9cf4d0-ac') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG os_vif [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2e:84,bridge_name='br-int',has_traffic_filtering=True,id=7a9cf4d0-ac7d-4d89-b175-c6519bb86979,network=Network(4360a01c-f5c5-4d5f-86f0-0ace428bfe0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9cf4d0-ac') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a9cf4d0-ac, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13ec5b99-861b-499d-b923-f69c6c553c7c) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:28 user nova-compute[75018]: INFO os_vif [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2e:84,bridge_name='br-int',has_traffic_filtering=True,id=7a9cf4d0-ac7d-4d89-b175-c6519bb86979,network=Network(4360a01c-f5c5-4d5f-86f0-0ace428bfe0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9cf4d0-ac')
Nov 07 15:35:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Deleting instance files /opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf_del
Nov 07 15:35:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Deletion of /opt/stack/data/nova/instances/2e5c462d-2ce2-4b95-816e-ac7ee26e85bf_del complete
Nov 07 15:35:28 user nova-compute[75018]: INFO nova.compute.manager [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 07 15:35:28 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:35:28 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:35:29 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Took 0.55 seconds to deallocate network for instance.
Nov 07 15:35:29 user nova-compute[75018]: DEBUG nova.compute.manager [req-8b5078fd-c6c1-46d3-89a9-3897ee1a3719 req-150e8606-76d6-4544-ad3f-e3f1f2865401 service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Received event network-vif-deleted-7a9cf4d0-ac7d-4d89-b175-c6519bb86979 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:35:29 user nova-compute[75018]: INFO nova.compute.manager [req-8b5078fd-c6c1-46d3-89a9-3897ee1a3719 req-150e8606-76d6-4544-ad3f-e3f1f2865401 service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Neutron deleted interface 7a9cf4d0-ac7d-4d89-b175-c6519bb86979; detaching it from the instance and deleting it from the info cache
Nov 07 15:35:29 user nova-compute[75018]: DEBUG nova.network.neutron [req-8b5078fd-c6c1-46d3-89a9-3897ee1a3719 req-150e8606-76d6-4544-ad3f-e3f1f2865401 service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:35:29 user nova-compute[75018]: DEBUG nova.compute.manager [req-8b5078fd-c6c1-46d3-89a9-3897ee1a3719 req-150e8606-76d6-4544-ad3f-e3f1f2865401 service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Detach interface failed, port_id=7a9cf4d0-ac7d-4d89-b175-c6519bb86979, reason: Instance 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:35:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:29 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:35:29 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:35:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:29 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Deleted allocations for instance 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf
Nov 07 15:35:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ae54412c-b881-4fe7-a8b8-6a5fe3e8bf25 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.926s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:35:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:35:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:35:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-6ddf1059-ac0b-4412-a3d5-ca285ec30251 req-f4fd338a-5917-4a10-b935-5f23c151839b service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Received event network-vif-plugged-7a9cf4d0-ac7d-4d89-b175-c6519bb86979 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:35:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6ddf1059-ac0b-4412-a3d5-ca285ec30251 req-f4fd338a-5917-4a10-b935-5f23c151839b service nova] Acquiring lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6ddf1059-ac0b-4412-a3d5-ca285ec30251 req-f4fd338a-5917-4a10-b935-5f23c151839b service nova] Lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6ddf1059-ac0b-4412-a3d5-ca285ec30251 req-f4fd338a-5917-4a10-b935-5f23c151839b service nova] Lock "2e5c462d-2ce2-4b95-816e-ac7ee26e85bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-6ddf1059-ac0b-4412-a3d5-ca285ec30251 req-f4fd338a-5917-4a10-b935-5f23c151839b service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] No waiting events found dispatching network-vif-plugged-7a9cf4d0-ac7d-4d89-b175-c6519bb86979 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:35:30 user nova-compute[75018]: WARNING nova.compute.manager [req-6ddf1059-ac0b-4412-a3d5-ca285ec30251 req-f4fd338a-5917-4a10-b935-5f23c151839b service nova] [instance: 2e5c462d-2ce2-4b95-816e-ac7ee26e85bf] Received unexpected event network-vif-plugged-7a9cf4d0-ac7d-4d89-b175-c6519bb86979 for instance with vm_state deleted and task_state None.
Nov 07 15:35:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'flavor' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquired lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG nova.network.neutron [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'info_cache' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG nova.objects.base [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Object Instance<af83bfa8-3661-4456-8854-f6c457e149fa> lazy-loaded attributes: flavor,info_cache {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG nova.network.neutron [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Updating instance_info_cache with network_info: [{"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Releasing lock "refresh_cache-af83bfa8-3661-4456-8854-f6c457e149fa" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:35:32 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Instance destroyed successfully.
Nov 07 15:35:32 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'resources' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG nova.objects.base [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Object Instance<af83bfa8-3661-4456-8854-f6c457e149fa> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-986489796',display_name='tempest-AttachVolumeTestJSON-server-986489796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-986489796',id=16,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0hEy6Pitp5/KtTEnBNkgUOns4w4ZMcmpTxmXDQ4xItuv4tIAT4CtKyRNJPdDjMXKTP3ENKo04CbmAPNdTPLrhWCvD73ElO9TJ8YQaIuoQSR42PL5M7RpYpZUxIXnp/KA==',key_name='tempest-keypair-1896323243',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:26:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='393342d93e71462eba531f173860d59f',ramdisk_id='',reservation_id='r-6g6bfllt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1503001538',owner_user_name='tempest-AttachVolumeTestJSON-1503001538-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:33:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8af061ec9b2444ecbbc2d1ef913fe558',uuid=af83bfa8-3661-4456-8854-f6c457e149fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converting VIF {"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG os_vif [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap305ed47b-06, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40dbfc19-37af-45e3-bb99-8dbf4bc25780) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:33 user nova-compute[75018]: INFO os_vif [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06')
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Start _get_guest_xml network_info=[{"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'numa_topology' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.objects.base [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Object Instance<af83bfa8-3661-4456-8854-f6c457e149fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:35:33 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:35:33 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'vcpu_model' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.objects.base [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Object Instance<af83bfa8-3661-4456-8854-f6c457e149fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-986489796',display_name='tempest-AttachVolumeTestJSON-server-986489796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-986489796',id=16,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0hEy6Pitp5/KtTEnBNkgUOns4w4ZMcmpTxmXDQ4xItuv4tIAT4CtKyRNJPdDjMXKTP3ENKo04CbmAPNdTPLrhWCvD73ElO9TJ8YQaIuoQSR42PL5M7RpYpZUxIXnp/KA==',key_name='tempest-keypair-1896323243',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:26:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='393342d93e71462eba531f173860d59f',ramdisk_id='',reservation_id='r-6g6bfllt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1503001538',owner_user_name='tempest-AttachVolumeTestJSON-1503001538-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:33:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8af061ec9b2444ecbbc2d1ef913fe558',uuid=af83bfa8-3661-4456-8854-f6c457e149fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converting VIF {"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'pci_devices' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.objects.base [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Object Instance<af83bfa8-3661-4456-8854-f6c457e149fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:35:33 user nova-compute[75018]:   <uuid>af83bfa8-3661-4456-8854-f6c457e149fa</uuid>
Nov 07 15:35:33 user nova-compute[75018]:   <name>instance-00000010</name>
Nov 07 15:35:33 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:35:33 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:35:33 user nova-compute[75018]:   <metadata>
Nov 07 15:35:33 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:35:33 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:35:33 user nova-compute[75018]:       <nova:name>tempest-AttachVolumeTestJSON-server-986489796</nova:name>
Nov 07 15:35:33 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:35:33</nova:creationTime>
Nov 07 15:35:33 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:35:33 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:35:33 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:35:33 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:35:33 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:35:33 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:35:33 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:35:33 user nova-compute[75018]:       <nova:owner>
Nov 07 15:35:33 user nova-compute[75018]:         <nova:user uuid="8af061ec9b2444ecbbc2d1ef913fe558">tempest-AttachVolumeTestJSON-1503001538-project-member</nova:user>
Nov 07 15:35:33 user nova-compute[75018]:         <nova:project uuid="393342d93e71462eba531f173860d59f">tempest-AttachVolumeTestJSON-1503001538</nova:project>
Nov 07 15:35:33 user nova-compute[75018]:       </nova:owner>
Nov 07 15:35:33 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:35:33 user nova-compute[75018]:       <nova:ports>
Nov 07 15:35:33 user nova-compute[75018]:         <nova:port uuid="305ed47b-06ed-48aa-9584-70e46a35bded">
Nov 07 15:35:33 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 15:35:33 user nova-compute[75018]:         </nova:port>
Nov 07 15:35:33 user nova-compute[75018]:       </nova:ports>
Nov 07 15:35:33 user nova-compute[75018]:     </nova:instance>
Nov 07 15:35:33 user nova-compute[75018]:   </metadata>
Nov 07 15:35:33 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:35:33 user nova-compute[75018]:     <system>
Nov 07 15:35:33 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:35:33 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:35:33 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:35:33 user nova-compute[75018]:       <entry name="serial">af83bfa8-3661-4456-8854-f6c457e149fa</entry>
Nov 07 15:35:33 user nova-compute[75018]:       <entry name="uuid">af83bfa8-3661-4456-8854-f6c457e149fa</entry>
Nov 07 15:35:33 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:35:33 user nova-compute[75018]:     </system>
Nov 07 15:35:33 user nova-compute[75018]:   </sysinfo>
Nov 07 15:35:33 user nova-compute[75018]:   <os>
Nov 07 15:35:33 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:35:33 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:35:33 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:35:33 user nova-compute[75018]:   </os>
Nov 07 15:35:33 user nova-compute[75018]:   <features>
Nov 07 15:35:33 user nova-compute[75018]:     <acpi/>
Nov 07 15:35:33 user nova-compute[75018]:     <apic/>
Nov 07 15:35:33 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:35:33 user nova-compute[75018]:   </features>
Nov 07 15:35:33 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:35:33 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:35:33 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:35:33 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:35:33 user nova-compute[75018]:   </clock>
Nov 07 15:35:33 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:35:33 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:35:33 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:35:33 user nova-compute[75018]:   </cpu>
Nov 07 15:35:33 user nova-compute[75018]:   <devices>
Nov 07 15:35:33 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:35:33 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:35:33 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk"/>
Nov 07 15:35:33 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:35:33 user nova-compute[75018]:     </disk>
Nov 07 15:35:33 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:35:33 user nova-compute[75018]:       <mac address="fa:16:3e:f8:80:43"/>
Nov 07 15:35:33 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:35:33 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:35:33 user nova-compute[75018]:       <target dev="tap305ed47b-06"/>
Nov 07 15:35:33 user nova-compute[75018]:     </interface>
Nov 07 15:35:33 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:35:33 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/console.log" append="off"/>
Nov 07 15:35:33 user nova-compute[75018]:     </serial>
Nov 07 15:35:33 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:35:33 user nova-compute[75018]:     <video>
Nov 07 15:35:33 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:35:33 user nova-compute[75018]:     </video>
Nov 07 15:35:33 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:35:33 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:35:33 user nova-compute[75018]:     </rng>
Nov 07 15:35:33 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:35:33 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:35:33 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:35:33 user nova-compute[75018]:     </memballoon>
Nov 07 15:35:33 user nova-compute[75018]:   </devices>
Nov 07 15:35:33 user nova-compute[75018]: </domain>
Nov 07 15:35:33 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Updating instance_info_cache with network_info: [{"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'trusted_certs' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.objects.base [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Object Instance<af83bfa8-3661-4456-8854-f6c457e149fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Cannot resize image /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'migration_context' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.objects.base [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Object Instance<af83bfa8-3661-4456-8854-f6c457e149fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-986489796',display_name='tempest-AttachVolumeTestJSON-server-986489796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-986489796',id=16,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0hEy6Pitp5/KtTEnBNkgUOns4w4ZMcmpTxmXDQ4xItuv4tIAT4CtKyRNJPdDjMXKTP3ENKo04CbmAPNdTPLrhWCvD73ElO9TJ8YQaIuoQSR42PL5M7RpYpZUxIXnp/KA==',key_name='tempest-keypair-1896323243',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:26:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='393342d93e71462eba531f173860d59f',ramdisk_id='',reservation_id='r-6g6bfllt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1503001538',owner_user_name='tempest-AttachVolumeTestJSON-1503001538-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:33:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8af061ec9b2444ecbbc2d1ef913fe558',uuid=af83bfa8-3661-4456-8854-f6c457e149fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converting VIF {"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG os_vif [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4643f90b-2904-5517-bad1-583bfdc19724', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap305ed47b-06, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap305ed47b-06, col_values=(('qos', UUID('70a6c002-3b46-46fc-9243-15ceb7056280')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap305ed47b-06, col_values=(('external_ids', {'iface-id': '305ed47b-06ed-48aa-9584-70e46a35bded', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:80:43', 'vm-uuid': 'af83bfa8-3661-4456-8854-f6c457e149fa'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:35:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:33 user nova-compute[75018]: INFO os_vif [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06')
Nov 07 15:35:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:35 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:35:35 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:35:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-97dbd7b2-9f25-45df-8a30-e5b58d912d19 req-3816133f-67ad-4a1f-8582-27fc741ffbf0 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:35:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-97dbd7b2-9f25-45df-8a30-e5b58d912d19 req-3816133f-67ad-4a1f-8582-27fc741ffbf0 service nova] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-97dbd7b2-9f25-45df-8a30-e5b58d912d19 req-3816133f-67ad-4a1f-8582-27fc741ffbf0 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-97dbd7b2-9f25-45df-8a30-e5b58d912d19 req-3816133f-67ad-4a1f-8582-27fc741ffbf0 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-97dbd7b2-9f25-45df-8a30-e5b58d912d19 req-3816133f-67ad-4a1f-8582-27fc741ffbf0 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] No waiting events found dispatching network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:35:35 user nova-compute[75018]: WARNING nova.compute.manager [req-97dbd7b2-9f25-45df-8a30-e5b58d912d19 req-3816133f-67ad-4a1f-8582-27fc741ffbf0 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received unexpected event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded for instance with vm_state stopped and task_state powering-on.
Nov 07 15:35:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:35 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:35:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:35:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-7e35022f-df71-4ea4-a067-b54cfea0834c req-252fe01d-4f71-4621-aac4-e7c8a64fa682 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7e35022f-df71-4ea4-a067-b54cfea0834c req-252fe01d-4f71-4621-aac4-e7c8a64fa682 service nova] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7e35022f-df71-4ea4-a067-b54cfea0834c req-252fe01d-4f71-4621-aac4-e7c8a64fa682 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7e35022f-df71-4ea4-a067-b54cfea0834c req-252fe01d-4f71-4621-aac4-e7c8a64fa682 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-7e35022f-df71-4ea4-a067-b54cfea0834c req-252fe01d-4f71-4621-aac4-e7c8a64fa682 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] No waiting events found dispatching network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:35:37 user nova-compute[75018]: WARNING nova.compute.manager [req-7e35022f-df71-4ea4-a067-b54cfea0834c req-252fe01d-4f71-4621-aac4-e7c8a64fa682 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received unexpected event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded for instance with vm_state stopped and task_state powering-on.
Nov 07 15:35:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:35:38 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Instance rebooted successfully.
Nov 07 15:35:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-3669488d-8156-412f-b315-cb074fa6b40d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:35:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:35:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:35:40 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:35:40 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:35:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7720MB free_disk=25.112773895263672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:35:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:35:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance af83bfa8-3661-4456-8854-f6c457e149fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:35:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:35:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:35:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:35:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 31e90a00-c2df-493c-9b7e-12d3063b877f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:35:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:35:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fd9de68b-2c19-498a-866d-f68848b2c5c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:35:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:35:40 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:35:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:41 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:35:41 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:35:41 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:35:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.747s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:35:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:35:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:35:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:35:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:35:57 user nova-compute[75018]: INFO nova.compute.manager [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Detaching volume 68740783-277d-46d3-8306-02c4be843940
Nov 07 15:35:57 user nova-compute[75018]: INFO nova.virt.block_device [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Attempting to driver detach volume 68740783-277d-46d3-8306-02c4be843940 from mountpoint /dev/vdb
Nov 07 15:35:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Attempting to detach device vdb from instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:35:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:35:57 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:35:57 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 15:35:57 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:35:57 user nova-compute[75018]:   <serial>68740783-277d-46d3-8306-02c4be843940</serial>
Nov 07 15:35:57 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 15:35:57 user nova-compute[75018]: </disk>
Nov 07 15:35:57 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:35:57 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Successfully detached device vdb from instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a from the persistent domain config.
Nov 07 15:35:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:35:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:35:57 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:35:57 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 15:35:57 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:35:57 user nova-compute[75018]:   <serial>68740783-277d-46d3-8306-02c4be843940</serial>
Nov 07 15:35:57 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 15:35:57 user nova-compute[75018]: </disk>
Nov 07 15:35:57 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:35:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:35:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:18 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a is timed out.
Nov 07 15:36:18 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Successfully detached device vdb from instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a from the live domain config.
Nov 07 15:36:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UvVSmDLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:36:18 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2533b913-cf0a-419b-9e2e-bf8516d02b46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:36:18 user nova-compute[75018]: No targets found.
Nov 07 15:36:18 user nova-compute[75018]: iSNS:
Nov 07 15:36:18 user nova-compute[75018]: No targets found.
Nov 07 15:36:18 user nova-compute[75018]: STATIC:
Nov 07 15:36:18 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940
Nov 07 15:36:18 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:36:18 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:36:18 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12
Nov 07 15:36:18 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:36:18 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:36:18 user nova-compute[75018]: FIRMWARE:
Nov 07 15:36:18 user nova-compute[75018]: No targets found.
Nov 07 15:36:18 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:36:18 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:36:18 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb24123b-47aa-41c5-b445-525945f9ade7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[844f67b3-620f-4cac-9bba-508052f25503]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:36:18 user nova-compute[75018]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 (non-flash)
Nov 07 15:36:18 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 (non-flash)
Nov 07 15:36:18 user nova-compute[75018]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 (non-flash)
Nov 07 15:36:18 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb00467640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[69282e06-1c63-43b5-b7d5-bfa4ecef6cc1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[919e61ca-0b82-4cbc-b4ad-02b19b34c02e]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b157426-af66-431a-82ff-017a2d00bd89]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c3edbb-e37a-4f27-a6aa-988680db790a]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3148ccb8-ba51-4a30-89f0-55f663c52fe4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e15f04a-256f-4eb6-9b41-88ac87f8fb49]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260]
Nov 07 15:36:18 user nova-compute[75018]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940, portal: 172.16.0.220,3260] successful.
Nov 07 15:36:18 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68740783-277d-46d3-8306-02c4be843940 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f4af31-703f-47fe-932b-ccfdeff0d762]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] <== disconnect_volume: return (349ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:36:18 user nova-compute[75018]: INFO nova.compute.manager [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Detaching volume 114ee768-b3d6-48c2-9e59-cda69f9f8d12
Nov 07 15:36:18 user nova-compute[75018]: INFO nova.virt.block_device [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Attempting to driver detach volume 114ee768-b3d6-48c2-9e59-cda69f9f8d12 from mountpoint /dev/vdb
Nov 07 15:36:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Attempting to detach device vdb from instance 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:36:18 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:36:18 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:36:18 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:36:18 user nova-compute[75018]:   <serial>114ee768-b3d6-48c2-9e59-cda69f9f8d12</serial>
Nov 07 15:36:18 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:36:18 user nova-compute[75018]: </disk>
Nov 07 15:36:18 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:36:18 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Successfully detached device vdb from instance 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 from the persistent domain config.
Nov 07 15:36:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:36:18 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:36:18 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:36:18 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:36:18 user nova-compute[75018]:   <serial>114ee768-b3d6-48c2-9e59-cda69f9f8d12</serial>
Nov 07 15:36:18 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:36:18 user nova-compute[75018]: </disk>
Nov 07 15:36:18 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:36:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:36:19 user nova-compute[75018]: DEBUG nova.objects.instance [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lazy-loading 'flavor' on Instance uuid ec5ab630-cd90-4514-aa9c-e46efc0bf78a {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:36:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-91a1734b-bb47-4194-83d9-516bfad56e4f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.019s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:22 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:36:22 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 15:36:22 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] There are 0 instances to clean {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 15:36:23 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:36:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:27 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:36:28 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:36:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:36:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:36:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:36:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:36:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:33 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:36:33 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:36:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-ec5ab630-cd90-4514-aa9c-e46efc0bf78a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:36:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-ec5ab630-cd90-4514-aa9c-e46efc0bf78a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:36:33 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:36:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:34 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:36:35 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Updating instance_info_cache with network_info: [{"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:36:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-ec5ab630-cd90-4514-aa9c-e46efc0bf78a" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:36:35 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:36:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:36:35 user nova-compute[75018]: INFO nova.compute.claims [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Claim successful on node user
Nov 07 15:36:35 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:36:35 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:36:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:35 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:36:35 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:36:35 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:36:35 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:36:35 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG nova.policy [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '869a94fcb52246d583be8bac4a722a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374a202b7d114f009ac374762e08c364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:36:36 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Creating image(s)
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "/opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "/opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.248s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.198s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk 1073741824" returned: 0 in 0.063s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.190s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:36:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Cannot resize image /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Ensure instance console log exists: /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Acquiring lock "374fbc2b-2e56-454e-a661-89c94af582ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "374fbc2b-2e56-454e-a661-89c94af582ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:36:37 user nova-compute[75018]: INFO nova.compute.claims [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Claim successful on node user
Nov 07 15:36:37 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Successfully created port: 280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Refreshing inventories for resource provider 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Updating ProviderTree inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Refreshing aggregate associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, aggregates: None {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 15:36:37 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Refreshing trait associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 15:36:38 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:36:38 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:36:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.712s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:36:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.713s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:38 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:36:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:36:38 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:36:38 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:36:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:36:38 user nova-compute[75018]: DEBUG nova.policy [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bae1f496c344ad28c0393b076aa4fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d86071a5b854c9ba57c2ed62cf04de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:36:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:36:39 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Creating image(s)
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Acquiring lock "/opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "/opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "/opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.251s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 is timed out.
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Successfully updated port: 280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:36:39 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Successfully detached device vdb from instance 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 from the live domain config.
Nov 07 15:36:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsxmwBvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:36:39 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:36:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquired lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.241s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e22eaf9-582d-422b-84b9-87a8768e246f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:36:39 user nova-compute[75018]: No targets found.
Nov 07 15:36:39 user nova-compute[75018]: iSNS:
Nov 07 15:36:39 user nova-compute[75018]: No targets found.
Nov 07 15:36:39 user nova-compute[75018]: STATIC:
Nov 07 15:36:39 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12
Nov 07 15:36:39 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:36:39 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:36:39 user nova-compute[75018]: FIRMWARE:
Nov 07 15:36:39 user nova-compute[75018]: No targets found.
Nov 07 15:36:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:36:39 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:36:39 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/disk 1073741824" returned: 0 in 0.083s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1120e88d-494f-469f-b609-407d025251ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e1c8ea-9a45-47d8-84c5-3f2b0419fa85]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 (non-flash)
Nov 07 15:36:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 (non-flash)
Nov 07 15:36:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae035a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12'): ({'sdd'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Removing single pathed devices sdd {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-0f25083d-0c4e-48f2-9ace-15303457429c req-4bd215ad-2590-41a4-98cd-31dc3469c1c7 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-changed-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-0f25083d-0c4e-48f2-9ace-15303457429c req-4bd215ad-2590-41a4-98cd-31dc3469c1c7 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Refreshing instance network info cache due to event network-changed-280fe9e4-a375-4c55-adf5-babbe012ef3b. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0f25083d-0c4e-48f2-9ace-15303457429c req-4bd215ad-2590-41a4-98cd-31dc3469c1c7 service nova] Acquiring lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b959e5f7-986c-4fa8-a3aa-74feadc23e23]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ced5e5f-bd77-4726-ad50-ccba88a6cd0d]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Flushing IO for device /dev/sdd {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c721c7-8d05-4812-9432-bd85b167e9e0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.293s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Checking if we can resize image /opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:36:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Successfully created port: 27e0ec73-3d90-434e-a755-47b5778359c0 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.073s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8974fbad-65c3-462e-9057-a82eb1a97106]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "98c33773-942b-422b-b4fd-a2b548260c09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[718b0950-ee9f-44d3-b0e6-49603794a039]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce864a58-9e0d-4970-a494-8e66b49e48b6]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12, portal: 172.16.0.220,3260]
Nov 07 15:36:40 user nova-compute[75018]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12, portal: 172.16.0.220,3260] successful.
Nov 07 15:36:40 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Cannot resize image /opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Ensure instance console log exists: /opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[449381f6-0560-4b90-b35c-a2c103213bf2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.658s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] <== disconnect_volume: return (661ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updating instance_info_cache with network_info: [{"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Releasing lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Instance network_info: |[{"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0f25083d-0c4e-48f2-9ace-15303457429c req-4bd215ad-2590-41a4-98cd-31dc3469c1c7 service nova] Acquired lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.network.neutron [req-0f25083d-0c4e-48f2-9ace-15303457429c req-4bd215ad-2590-41a4-98cd-31dc3469c1c7 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Refreshing network info cache for port 280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Start _get_guest_xml network_info=[{"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:36:40 user nova-compute[75018]: INFO nova.compute.claims [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Claim successful on node user
Nov 07 15:36:40 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:36:40 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:36:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-383028183',display_name='tempest-ServerRescueNegativeTestJSON-server-383028183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-383028183',id=28,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXlVLFR1auiipSprdX96rkwHLVObqrWok4UB8xbGBLwxbV3XoGdfCwIP9llsZoGGWjO60XbhFNifEi5pPhV3RvNdDG0ZBk1XRXIWWyz6JGQQrqGIsByOItviiS/2raJrA==',key_name='tempest-keypair-1034588000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374a202b7d114f009ac374762e08c364',ramdisk_id='',reservation_id='r-x55em1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1476352427',owner_user_name='tempest-ServerRescueNegativeTestJSON-1476352427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:36:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='869a94fcb52246d583be8bac4a722a3c',uuid=e4ad018d-bdc7-458b-9e77-ba31457e52ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converting VIF {"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:84:70,bridge_name='br-int',has_traffic_filtering=True,id=280fe9e4-a375-4c55-adf5-babbe012ef3b,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280fe9e4-a3') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.objects.instance [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'pci_devices' on Instance uuid e4ad018d-bdc7-458b-9e77-ba31457e52ff {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:36:40 user nova-compute[75018]:   <uuid>e4ad018d-bdc7-458b-9e77-ba31457e52ff</uuid>
Nov 07 15:36:40 user nova-compute[75018]:   <name>instance-0000001c</name>
Nov 07 15:36:40 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:36:40 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:36:40 user nova-compute[75018]:   <metadata>
Nov 07 15:36:40 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:36:40 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:36:40 user nova-compute[75018]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-383028183</nova:name>
Nov 07 15:36:40 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:36:40</nova:creationTime>
Nov 07 15:36:40 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:36:40 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:36:40 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:36:40 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:36:40 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:36:40 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:36:40 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:36:40 user nova-compute[75018]:       <nova:owner>
Nov 07 15:36:40 user nova-compute[75018]:         <nova:user uuid="869a94fcb52246d583be8bac4a722a3c">tempest-ServerRescueNegativeTestJSON-1476352427-project-member</nova:user>
Nov 07 15:36:40 user nova-compute[75018]:         <nova:project uuid="374a202b7d114f009ac374762e08c364">tempest-ServerRescueNegativeTestJSON-1476352427</nova:project>
Nov 07 15:36:40 user nova-compute[75018]:       </nova:owner>
Nov 07 15:36:40 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:36:40 user nova-compute[75018]:       <nova:ports>
Nov 07 15:36:40 user nova-compute[75018]:         <nova:port uuid="280fe9e4-a375-4c55-adf5-babbe012ef3b">
Nov 07 15:36:40 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 07 15:36:40 user nova-compute[75018]:         </nova:port>
Nov 07 15:36:40 user nova-compute[75018]:       </nova:ports>
Nov 07 15:36:40 user nova-compute[75018]:     </nova:instance>
Nov 07 15:36:40 user nova-compute[75018]:   </metadata>
Nov 07 15:36:40 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:36:40 user nova-compute[75018]:     <system>
Nov 07 15:36:40 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:36:40 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:36:40 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:36:40 user nova-compute[75018]:       <entry name="serial">e4ad018d-bdc7-458b-9e77-ba31457e52ff</entry>
Nov 07 15:36:40 user nova-compute[75018]:       <entry name="uuid">e4ad018d-bdc7-458b-9e77-ba31457e52ff</entry>
Nov 07 15:36:40 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:36:40 user nova-compute[75018]:     </system>
Nov 07 15:36:40 user nova-compute[75018]:   </sysinfo>
Nov 07 15:36:40 user nova-compute[75018]:   <os>
Nov 07 15:36:40 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:36:40 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:36:40 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:36:40 user nova-compute[75018]:   </os>
Nov 07 15:36:40 user nova-compute[75018]:   <features>
Nov 07 15:36:40 user nova-compute[75018]:     <acpi/>
Nov 07 15:36:40 user nova-compute[75018]:     <apic/>
Nov 07 15:36:40 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:36:40 user nova-compute[75018]:   </features>
Nov 07 15:36:40 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:36:40 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:36:40 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:36:40 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:36:40 user nova-compute[75018]:   </clock>
Nov 07 15:36:40 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:36:40 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:36:40 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:36:40 user nova-compute[75018]:   </cpu>
Nov 07 15:36:40 user nova-compute[75018]:   <devices>
Nov 07 15:36:40 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:36:40 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:36:40 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk"/>
Nov 07 15:36:40 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:36:40 user nova-compute[75018]:     </disk>
Nov 07 15:36:40 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:36:40 user nova-compute[75018]:       <mac address="fa:16:3e:a7:84:70"/>
Nov 07 15:36:40 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:36:40 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:36:40 user nova-compute[75018]:       <target dev="tap280fe9e4-a3"/>
Nov 07 15:36:40 user nova-compute[75018]:     </interface>
Nov 07 15:36:40 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:36:40 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/console.log" append="off"/>
Nov 07 15:36:40 user nova-compute[75018]:     </serial>
Nov 07 15:36:40 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:36:40 user nova-compute[75018]:     <video>
Nov 07 15:36:40 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:36:40 user nova-compute[75018]:     </video>
Nov 07 15:36:40 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:36:40 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:36:40 user nova-compute[75018]:     </rng>
Nov 07 15:36:40 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:36:40 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:36:40 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:36:40 user nova-compute[75018]:     </memballoon>
Nov 07 15:36:40 user nova-compute[75018]:   </devices>
Nov 07 15:36:40 user nova-compute[75018]: </domain>
Nov 07 15:36:40 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:36:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-383028183',display_name='tempest-ServerRescueNegativeTestJSON-server-383028183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-383028183',id=28,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXlVLFR1auiipSprdX96rkwHLVObqrWok4UB8xbGBLwxbV3XoGdfCwIP9llsZoGGWjO60XbhFNifEi5pPhV3RvNdDG0ZBk1XRXIWWyz6JGQQrqGIsByOItviiS/2raJrA==',key_name='tempest-keypair-1034588000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374a202b7d114f009ac374762e08c364',ramdisk_id='',reservation_id='r-x55em1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1476352427',owner_user_name='tempest-ServerRescueNegativeTestJSON-1476352427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:36:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='869a94fcb52246d583be8bac4a722a3c',uuid=e4ad018d-bdc7-458b-9e77-ba31457e52ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converting VIF {"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:84:70,bridge_name='br-int',has_traffic_filtering=True,id=280fe9e4-a375-4c55-adf5-babbe012ef3b,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280fe9e4-a3') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG os_vif [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:84:70,bridge_name='br-int',has_traffic_filtering=True,id=280fe9e4-a375-4c55-adf5-babbe012ef3b,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280fe9e4-a3') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9452104e-7045-5b83-9ba9-a81db8e4874d', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap280fe9e4-a3, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap280fe9e4-a3, col_values=(('qos', UUID('b14e9ef6-0299-463b-984a-c8e1fc0e775c')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap280fe9e4-a3, col_values=(('external_ids', {'iface-id': '280fe9e4-a375-4c55-adf5-babbe012ef3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:84:70', 'vm-uuid': 'e4ad018d-bdc7-458b-9e77-ba31457e52ff'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:36:40 user nova-compute[75018]: INFO os_vif [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:84:70,bridge_name='br-int',has_traffic_filtering=True,id=280fe9e4-a375-4c55-adf5-babbe012ef3b,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280fe9e4-a3')
Nov 07 15:36:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No VIF found with MAC fa:16:3e:a7:84:70, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:40 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Successfully updated port: 27e0ec73-3d90-434e-a755-47b5778359c0 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Acquiring lock "refresh_cache-374fbc2b-2e56-454e-a661-89c94af582ac" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Acquired lock "refresh_cache-374fbc2b-2e56-454e-a661-89c94af582ac" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.compute.manager [req-a8c4a382-6bd4-43ed-a2c8-ac437867a146 req-9f1eb6ca-a399-4661-8ccf-5553c8652770 service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Received event network-changed-27e0ec73-3d90-434e-a755-47b5778359c0 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.compute.manager [req-a8c4a382-6bd4-43ed-a2c8-ac437867a146 req-9f1eb6ca-a399-4661-8ccf-5553c8652770 service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Refreshing instance network info cache due to event network-changed-27e0ec73-3d90-434e-a755-47b5778359c0. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a8c4a382-6bd4-43ed-a2c8-ac437867a146 req-9f1eb6ca-a399-4661-8ccf-5553c8652770 service nova] Acquiring lock "refresh_cache-374fbc2b-2e56-454e-a661-89c94af582ac" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.network.neutron [req-0f25083d-0c4e-48f2-9ace-15303457429c req-4bd215ad-2590-41a4-98cd-31dc3469c1c7 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updated VIF entry in instance network info cache for port 280fe9e4-a375-4c55-adf5-babbe012ef3b. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.network.neutron [req-0f25083d-0c4e-48f2-9ace-15303457429c req-4bd215ad-2590-41a4-98cd-31dc3469c1c7 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updating instance_info_cache with network_info: [{"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0f25083d-0c4e-48f2-9ace-15303457429c req-4bd215ad-2590-41a4-98cd-31dc3469c1c7 service nova] Releasing lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.883s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:36:41 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Updating instance_info_cache with network_info: [{"id": "27e0ec73-3d90-434e-a755-47b5778359c0", "address": "fa:16:3e:67:82:c9", "network": {"id": "ad00e229-3149-4aae-ac71-dad21e6a09d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9ad2a7b49899449c8127f8306add3c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e0ec73-3d", "ovs_interfaceid": "27e0ec73-3d90-434e-a755-47b5778359c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.policy [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5dd323d14ebd4f418ef98952c0efbe29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e330da770824aad9f8e6c1e312c2e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Releasing lock "refresh_cache-374fbc2b-2e56-454e-a661-89c94af582ac" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Instance network_info: |[{"id": "27e0ec73-3d90-434e-a755-47b5778359c0", "address": "fa:16:3e:67:82:c9", "network": {"id": "ad00e229-3149-4aae-ac71-dad21e6a09d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9ad2a7b49899449c8127f8306add3c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e0ec73-3d", "ovs_interfaceid": "27e0ec73-3d90-434e-a755-47b5778359c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a8c4a382-6bd4-43ed-a2c8-ac437867a146 req-9f1eb6ca-a399-4661-8ccf-5553c8652770 service nova] Acquired lock "refresh_cache-374fbc2b-2e56-454e-a661-89c94af582ac" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.network.neutron [req-a8c4a382-6bd4-43ed-a2c8-ac437867a146 req-9f1eb6ca-a399-4661-8ccf-5553c8652770 service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Refreshing network info cache for port 27e0ec73-3d90-434e-a755-47b5778359c0 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Start _get_guest_xml network_info=[{"id": "27e0ec73-3d90-434e-a755-47b5778359c0", "address": "fa:16:3e:67:82:c9", "network": {"id": "ad00e229-3149-4aae-ac71-dad21e6a09d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9ad2a7b49899449c8127f8306add3c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e0ec73-3d", "ovs_interfaceid": "27e0ec73-3d90-434e-a755-47b5778359c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:36:41 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:36:41 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:36:41 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Creating image(s)
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "/opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "/opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "/opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.291s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.objects.instance [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lazy-loading 'flavor' on Instance uuid 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-517816215',display_name='tempest-VolumesNegativeTest-instance-517816215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-517816215',id=29,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d86071a5b854c9ba57c2ed62cf04de2',ramdisk_id='',reservation_id='r-nyivyvpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1528193776',owner_user_name='tempest-VolumesNegativeTest-1528193776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:36:39Z,user_data=None,user_id='8bae1f496c344ad28c0393b076aa4fdb',uuid=374fbc2b-2e56-454e-a661-89c94af582ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27e0ec73-3d90-434e-a755-47b5778359c0", "address": "fa:16:3e:67:82:c9", "network": {"id": "ad00e229-3149-4aae-ac71-dad21e6a09d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9ad2a7b49899449c8127f8306add3c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e0ec73-3d", "ovs_interfaceid": "27e0ec73-3d90-434e-a755-47b5778359c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Converting VIF {"id": "27e0ec73-3d90-434e-a755-47b5778359c0", "address": "fa:16:3e:67:82:c9", "network": {"id": "ad00e229-3149-4aae-ac71-dad21e6a09d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9ad2a7b49899449c8127f8306add3c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e0ec73-3d", "ovs_interfaceid": "27e0ec73-3d90-434e-a755-47b5778359c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:82:c9,bridge_name='br-int',has_traffic_filtering=True,id=27e0ec73-3d90-434e-a755-47b5778359c0,network=Network(ad00e229-3149-4aae-ac71-dad21e6a09d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e0ec73-3d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.objects.instance [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lazy-loading 'pci_devices' on Instance uuid 374fbc2b-2e56-454e-a661-89c94af582ac {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:36:41 user nova-compute[75018]:   <uuid>374fbc2b-2e56-454e-a661-89c94af582ac</uuid>
Nov 07 15:36:41 user nova-compute[75018]:   <name>instance-0000001d</name>
Nov 07 15:36:41 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:36:41 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:36:41 user nova-compute[75018]:   <metadata>
Nov 07 15:36:41 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:36:41 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:36:41 user nova-compute[75018]:       <nova:name>tempest-VolumesNegativeTest-instance-517816215</nova:name>
Nov 07 15:36:41 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:36:41</nova:creationTime>
Nov 07 15:36:41 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:36:41 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:36:41 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:36:41 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:36:41 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:36:41 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:36:41 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:36:41 user nova-compute[75018]:       <nova:owner>
Nov 07 15:36:41 user nova-compute[75018]:         <nova:user uuid="8bae1f496c344ad28c0393b076aa4fdb">tempest-VolumesNegativeTest-1528193776-project-member</nova:user>
Nov 07 15:36:41 user nova-compute[75018]:         <nova:project uuid="3d86071a5b854c9ba57c2ed62cf04de2">tempest-VolumesNegativeTest-1528193776</nova:project>
Nov 07 15:36:41 user nova-compute[75018]:       </nova:owner>
Nov 07 15:36:41 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:36:41 user nova-compute[75018]:       <nova:ports>
Nov 07 15:36:41 user nova-compute[75018]:         <nova:port uuid="27e0ec73-3d90-434e-a755-47b5778359c0">
Nov 07 15:36:41 user nova-compute[75018]:           <nova:ip type="fixed" address="192.168.233.170" ipVersion="4"/>
Nov 07 15:36:41 user nova-compute[75018]:         </nova:port>
Nov 07 15:36:41 user nova-compute[75018]:       </nova:ports>
Nov 07 15:36:41 user nova-compute[75018]:     </nova:instance>
Nov 07 15:36:41 user nova-compute[75018]:   </metadata>
Nov 07 15:36:41 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:36:41 user nova-compute[75018]:     <system>
Nov 07 15:36:41 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:36:41 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:36:41 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:36:41 user nova-compute[75018]:       <entry name="serial">374fbc2b-2e56-454e-a661-89c94af582ac</entry>
Nov 07 15:36:41 user nova-compute[75018]:       <entry name="uuid">374fbc2b-2e56-454e-a661-89c94af582ac</entry>
Nov 07 15:36:41 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:36:41 user nova-compute[75018]:     </system>
Nov 07 15:36:41 user nova-compute[75018]:   </sysinfo>
Nov 07 15:36:41 user nova-compute[75018]:   <os>
Nov 07 15:36:41 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:36:41 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:36:41 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:36:41 user nova-compute[75018]:   </os>
Nov 07 15:36:41 user nova-compute[75018]:   <features>
Nov 07 15:36:41 user nova-compute[75018]:     <acpi/>
Nov 07 15:36:41 user nova-compute[75018]:     <apic/>
Nov 07 15:36:41 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:36:41 user nova-compute[75018]:   </features>
Nov 07 15:36:41 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:36:41 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:36:41 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:36:41 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:36:41 user nova-compute[75018]:   </clock>
Nov 07 15:36:41 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:36:41 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:36:41 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:36:41 user nova-compute[75018]:   </cpu>
Nov 07 15:36:41 user nova-compute[75018]:   <devices>
Nov 07 15:36:41 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:36:41 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:36:41 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/disk"/>
Nov 07 15:36:41 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:36:41 user nova-compute[75018]:     </disk>
Nov 07 15:36:41 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:36:41 user nova-compute[75018]:       <mac address="fa:16:3e:67:82:c9"/>
Nov 07 15:36:41 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:36:41 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:36:41 user nova-compute[75018]:       <target dev="tap27e0ec73-3d"/>
Nov 07 15:36:41 user nova-compute[75018]:     </interface>
Nov 07 15:36:41 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:36:41 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/console.log" append="off"/>
Nov 07 15:36:41 user nova-compute[75018]:     </serial>
Nov 07 15:36:41 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:36:41 user nova-compute[75018]:     <video>
Nov 07 15:36:41 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:36:41 user nova-compute[75018]:     </video>
Nov 07 15:36:41 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:36:41 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:36:41 user nova-compute[75018]:     </rng>
Nov 07 15:36:41 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:36:41 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:36:41 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:36:41 user nova-compute[75018]:     </memballoon>
Nov 07 15:36:41 user nova-compute[75018]:   </devices>
Nov 07 15:36:41 user nova-compute[75018]: </domain>
Nov 07 15:36:41 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-517816215',display_name='tempest-VolumesNegativeTest-instance-517816215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-517816215',id=29,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d86071a5b854c9ba57c2ed62cf04de2',ramdisk_id='',reservation_id='r-nyivyvpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1528193776',owner_user_name='tempest-VolumesNegativeTest-1528193776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:36:39Z,user_data=None,user_id='8bae1f496c344ad28c0393b076aa4fdb',uuid=374fbc2b-2e56-454e-a661-89c94af582ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27e0ec73-3d90-434e-a755-47b5778359c0", "address": "fa:16:3e:67:82:c9", "network": {"id": "ad00e229-3149-4aae-ac71-dad21e6a09d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9ad2a7b49899449c8127f8306add3c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e0ec73-3d", "ovs_interfaceid": "27e0ec73-3d90-434e-a755-47b5778359c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Converting VIF {"id": "27e0ec73-3d90-434e-a755-47b5778359c0", "address": "fa:16:3e:67:82:c9", "network": {"id": "ad00e229-3149-4aae-ac71-dad21e6a09d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9ad2a7b49899449c8127f8306add3c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e0ec73-3d", "ovs_interfaceid": "27e0ec73-3d90-434e-a755-47b5778359c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:82:c9,bridge_name='br-int',has_traffic_filtering=True,id=27e0ec73-3d90-434e-a755-47b5778359c0,network=Network(ad00e229-3149-4aae-ac71-dad21e6a09d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e0ec73-3d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG os_vif [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:82:c9,bridge_name='br-int',has_traffic_filtering=True,id=27e0ec73-3d90-434e-a755-47b5778359c0,network=Network(ad00e229-3149-4aae-ac71-dad21e6a09d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e0ec73-3d') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-92c9c7b8-a91d-43f4-85e2-756a07db7123 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.978s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.209s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ef4d1a5-66b8-5040-98f5-538c552d81a3', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.849s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:41 user nova-compute[75018]: INFO nova.compute.manager [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Terminating instance
Nov 07 15:36:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27e0ec73-3d, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27e0ec73-3d, col_values=(('qos', UUID('2c6c86a0-68c9-4cf8-8b57-317cfd2d98ff')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27e0ec73-3d, col_values=(('external_ids', {'iface-id': '27e0ec73-3d90-434e-a755-47b5778359c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:82:c9', 'vm-uuid': '374fbc2b-2e56-454e-a661-89c94af582ac'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:36:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:41 user nova-compute[75018]: INFO os_vif [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:82:c9,bridge_name='br-int',has_traffic_filtering=True,id=27e0ec73-3d90-434e-a755-47b5778359c0,network=Network(ad00e229-3149-4aae-ac71-dad21e6a09d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e0ec73-3d')
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.194s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk 1073741824" returned: 0 in 0.069s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] No VIF found with MAC fa:16:3e:67:82:c9, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG nova.network.neutron [req-a8c4a382-6bd4-43ed-a2c8-ac437867a146 req-9f1eb6ca-a399-4661-8ccf-5553c8652770 service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Updated VIF entry in instance network info cache for port 27e0ec73-3d90-434e-a755-47b5778359c0. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG nova.network.neutron [req-a8c4a382-6bd4-43ed-a2c8-ac437867a146 req-9f1eb6ca-a399-4661-8ccf-5553c8652770 service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Updating instance_info_cache with network_info: [{"id": "27e0ec73-3d90-434e-a755-47b5778359c0", "address": "fa:16:3e:67:82:c9", "network": {"id": "ad00e229-3149-4aae-ac71-dad21e6a09d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9ad2a7b49899449c8127f8306add3c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e0ec73-3d", "ovs_interfaceid": "27e0ec73-3d90-434e-a755-47b5778359c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a8c4a382-6bd4-43ed-a2c8-ac437867a146 req-9f1eb6ca-a399-4661-8ccf-5553c8652770 service nova] Releasing lock "refresh_cache-374fbc2b-2e56-454e-a661-89c94af582ac" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.271s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Successfully created port: 8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Cannot resize image /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Ensure instance console log exists: /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG nova.compute.manager [req-d61377fc-45c5-4f4d-b43f-760fb5b9b2f3 req-d28798bc-31cd-4582-83e3-8ba7739a1cd7 service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Received event network-vif-unplugged-ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d61377fc-45c5-4f4d-b43f-760fb5b9b2f3 req-d28798bc-31cd-4582-83e3-8ba7739a1cd7 service nova] Acquiring lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d61377fc-45c5-4f4d-b43f-760fb5b9b2f3 req-d28798bc-31cd-4582-83e3-8ba7739a1cd7 service nova] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d61377fc-45c5-4f4d-b43f-760fb5b9b2f3 req-d28798bc-31cd-4582-83e3-8ba7739a1cd7 service nova] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG nova.compute.manager [req-d61377fc-45c5-4f4d-b43f-760fb5b9b2f3 req-d28798bc-31cd-4582-83e3-8ba7739a1cd7 service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] No waiting events found dispatching network-vif-unplugged-ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG nova.compute.manager [req-d61377fc-45c5-4f4d-b43f-760fb5b9b2f3 req-d28798bc-31cd-4582-83e3-8ba7739a1cd7 service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Received event network-vif-unplugged-ecda3b03-86ac-4e5f-a1b1-d28806f2512a for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Successfully updated port: 8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-831b12b0-f3a2-47e9-b26b-db1261eb9c37 req-4f03808e-bdc6-461c-81d3-4ce69debe4dd service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Received event network-changed-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-831b12b0-f3a2-47e9-b26b-db1261eb9c37 req-4f03808e-bdc6-461c-81d3-4ce69debe4dd service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Refreshing instance network info cache due to event network-changed-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-831b12b0-f3a2-47e9-b26b-db1261eb9c37 req-4f03808e-bdc6-461c-81d3-4ce69debe4dd service nova] Acquiring lock "refresh_cache-98c33773-942b-422b-b4fd-a2b548260c09" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-831b12b0-f3a2-47e9-b26b-db1261eb9c37 req-4f03808e-bdc6-461c-81d3-4ce69debe4dd service nova] Acquired lock "refresh_cache-98c33773-942b-422b-b4fd-a2b548260c09" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.network.neutron [req-831b12b0-f3a2-47e9-b26b-db1261eb9c37 req-4f03808e-bdc6-461c-81d3-4ce69debe4dd service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Refreshing network info cache for port 8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "refresh_cache-98c33773-942b-422b-b4fd-a2b548260c09" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:36:44 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:36:44 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7710MB free_disk=25.096527099609375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:44 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Instance destroyed successfully.
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lazy-loading 'resources' on Instance uuid 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:31:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1304160086',display_name='tempest-VolumesSnapshotTestJSON-instance-1304160086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1304160086',id=23,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcgjfh0mRqGNOc19KV88V1Iyf4yPsO8J3ZNs/RIr59vs/rjT5pxmh75R9fvI4e5KCzgOkj8L5IZKNNLUS5h7y1HqgezpBvPjv9EMVUXhDLL7gSlqq1S+/DElIJloYQjkg==',key_name='tempest-keypair-2101687583',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:32:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0d39d9835e04ea393a5c6ef8046aac2',ramdisk_id='',reservation_id='r-g9ph6x1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-666600934',owner_user_name='tempest-VolumesSnapshotTestJSON-666600934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:32:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ecef8d2ab1c490d98e9f65e16241cf1',uuid=2fc7eecf-a7a9-410b-83d4-1cb15542aea2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "address": "fa:16:3e:8b:ff:20", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda3b03-86", "ovs_interfaceid": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Converting VIF {"id": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "address": "fa:16:3e:8b:ff:20", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecda3b03-86", "ovs_interfaceid": "ecda3b03-86ac-4e5f-a1b1-d28806f2512a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=ecda3b03-86ac-4e5f-a1b1-d28806f2512a,network=Network(85503726-f3c9-4bad-958c-d4bade647236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecda3b03-86') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG os_vif [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=ecda3b03-86ac-4e5f-a1b1-d28806f2512a,network=Network(85503726-f3c9-4bad-958c-d4bade647236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecda3b03-86') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecda3b03-86, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46cdb9fe-e064-4dba-af18-fced22a3a90f) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:44 user nova-compute[75018]: INFO os_vif [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=ecda3b03-86ac-4e5f-a1b1-d28806f2512a,network=Network(85503726-f3c9-4bad-958c-d4bade647236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecda3b03-86')
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:114ee768-b3d6-48c2-9e59-cda69f9f8d12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsxmwBvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:36:44 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:36:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.network.neutron [req-831b12b0-f3a2-47e9-b26b-db1261eb9c37 req-4f03808e-bdc6-461c-81d3-4ce69debe4dd service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance af83bfa8-3661-4456-8854-f6c457e149fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 31e90a00-c2df-493c-9b7e-12d3063b877f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 2fc7eecf-a7a9-410b-83d4-1cb15542aea2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fd9de68b-2c19-498a-866d-f68848b2c5c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e4ad018d-bdc7-458b-9e77-ba31457e52ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 374fbc2b-2e56-454e-a661-89c94af582ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 98c33773-942b-422b-b4fd-a2b548260c09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[5457d84a-0aba-479c-bff8-a0886020bdf0]: Unexpected error while running command.
Nov 07 15:36:44 user nova-compute[75018]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 07 15:36:44 user nova-compute[75018]: Exit code: 21
Nov 07 15:36:44 user nova-compute[75018]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 07 15:36:44 user nova-compute[75018]: Stderr: '' {{(pid=86127) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 07 15:36:44 user nova-compute[75018]: Traceback (most recent call last):
Nov 07 15:36:44 user nova-compute[75018]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 07 15:36:44 user nova-compute[75018]:     ret = func(*f_args, **f_kwargs)
Nov 07 15:36:44 user nova-compute[75018]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 07 15:36:44 user nova-compute[75018]:     return func(*args, **kwargs)
Nov 07 15:36:44 user nova-compute[75018]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 07 15:36:44 user nova-compute[75018]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 07 15:36:44 user nova-compute[75018]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 07 15:36:44 user nova-compute[75018]:     return putils.execute(on_execute=on_execute,
Nov 07 15:36:44 user nova-compute[75018]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 07 15:36:44 user nova-compute[75018]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 07 15:36:44 user nova-compute[75018]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 07 15:36:44 user nova-compute[75018]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 07 15:36:44 user nova-compute[75018]: Exit code: 21
Nov 07 15:36:44 user nova-compute[75018]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 07 15:36:44 user nova-compute[75018]: Stderr: ''
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5457d84a-0aba-479c-bff8-a0886020bdf0]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 07 15:36:44 user nova-compute[75018]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 07 15:36:44 user nova-compute[75018]: Exit code: 21
Nov 07 15:36:44 user nova-compute[75018]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 07 15:36:44 user nova-compute[75018]: Stderr: ''
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 07 15:36:44 user nova-compute[75018]: ERROR os_brick.initiator.connectors.iscsi 
Nov 07 15:36:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75018) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.237s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] <== disconnect_volume: return (239ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:36:44 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Deleting instance files /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2_del
Nov 07 15:36:44 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Deletion of /opt/stack/data/nova/instances/2fc7eecf-a7a9-410b-83d4-1cb15542aea2_del complete
Nov 07 15:36:44 user nova-compute[75018]: INFO nova.compute.manager [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Took 2.78 seconds to destroy the instance on the hypervisor.
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.network.neutron [req-831b12b0-f3a2-47e9-b26b-db1261eb9c37 req-4f03808e-bdc6-461c-81d3-4ce69debe4dd service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-831b12b0-f3a2-47e9-b26b-db1261eb9c37 req-4f03808e-bdc6-461c-81d3-4ce69debe4dd service nova] Releasing lock "refresh_cache-98c33773-942b-422b-b4fd-a2b548260c09" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquired lock "refresh_cache-98c33773-942b-422b-b4fd-a2b548260c09" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Received event network-vif-plugged-ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] Acquiring lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] No waiting events found dispatching network-vif-plugged-ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:44 user nova-compute[75018]: WARNING nova.compute.manager [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Received unexpected event network-vif-plugged-ecda3b03-86ac-4e5f-a1b1-d28806f2512a for instance with vm_state active and task_state deleting.
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] No waiting events found dispatching network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:44 user nova-compute[75018]: WARNING nova.compute.manager [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received unexpected event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b for instance with vm_state building and task_state spawning.
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] No waiting events found dispatching network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:44 user nova-compute[75018]: WARNING nova.compute.manager [req-4f9698ac-4572-46e5-9629-2962de7a907b req-23752f35-674e-46c9-bdcc-31cbb57868a5 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received unexpected event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b for instance with vm_state building and task_state spawning.
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:36:44 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.901s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75018) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:36:45 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Took 0.81 seconds to deallocate network for instance.
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-32f126c6-cc8e-4110-af50-17172c812a83 req-259e2d93-d301-4973-ac23-fa31321ff5bf service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Received event network-vif-plugged-27e0ec73-3d90-434e-a755-47b5778359c0 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-32f126c6-cc8e-4110-af50-17172c812a83 req-259e2d93-d301-4973-ac23-fa31321ff5bf service nova] Acquiring lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-32f126c6-cc8e-4110-af50-17172c812a83 req-259e2d93-d301-4973-ac23-fa31321ff5bf service nova] Lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-32f126c6-cc8e-4110-af50-17172c812a83 req-259e2d93-d301-4973-ac23-fa31321ff5bf service nova] Lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-32f126c6-cc8e-4110-af50-17172c812a83 req-259e2d93-d301-4973-ac23-fa31321ff5bf service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] No waiting events found dispatching network-vif-plugged-27e0ec73-3d90-434e-a755-47b5778359c0 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:45 user nova-compute[75018]: WARNING nova.compute.manager [req-32f126c6-cc8e-4110-af50-17172c812a83 req-259e2d93-d301-4973-ac23-fa31321ff5bf service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Received unexpected event network-vif-plugged-27e0ec73-3d90-434e-a755-47b5778359c0 for instance with vm_state building and task_state spawning.
Nov 07 15:36:45 user nova-compute[75018]: WARNING nova.volume.cinder [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Attachment 6f444021-4ed0-429b-ba61-0bc60f1ec092 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6f444021-4ed0-429b-ba61-0bc60f1ec092. (HTTP 404) (Request-ID: req-93f020d7-c8c6-4976-a3a7-63b5da137b31)
Nov 07 15:36:45 user nova-compute[75018]: INFO nova.compute.manager [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Took 0.05 seconds to detach 1 volumes for instance.
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-98a5b6af-23aa-478f-b51f-8b0ffc912ab7 req-7162eaaf-9c9f-410f-8c20-0323c9e39d4b service nova] [instance: 2fc7eecf-a7a9-410b-83d4-1cb15542aea2] Received event network-vif-deleted-ecda3b03-86ac-4e5f-a1b1-d28806f2512a {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Updating instance_info_cache with network_info: [{"id": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "address": "fa:16:3e:6f:c7:ae", "network": {"id": "3bc44c82-a575-4e5c-8661-2411b93b96bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1450868802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e330da770824aad9f8e6c1e312c2e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c33f4e9-4c", "ovs_interfaceid": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Releasing lock "refresh_cache-98c33773-942b-422b-b4fd-a2b548260c09" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Instance network_info: |[{"id": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "address": "fa:16:3e:6f:c7:ae", "network": {"id": "3bc44c82-a575-4e5c-8661-2411b93b96bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1450868802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e330da770824aad9f8e6c1e312c2e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c33f4e9-4c", "ovs_interfaceid": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Start _get_guest_xml network_info=[{"id": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "address": "fa:16:3e:6f:c7:ae", "network": {"id": "3bc44c82-a575-4e5c-8661-2411b93b96bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1450868802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e330da770824aad9f8e6c1e312c2e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c33f4e9-4c", "ovs_interfaceid": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:36:45 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:36:45 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:36:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2021335938',display_name='tempest-TestServerVolumeAttachmentScenario-server-2021335938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2021335938',id=30,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj6Lb+MDuLa2Cb3vOfLTbl8R5ZeB/z2uueEZdRiotCU45FfL7/xTRsyITLx1f8WgOj5GYxNRza5+/FwcsueVKsmOmBYHAmS+SHBEUk04JxN3NMWYxgsZXjYg5qfAeKmGw==',key_name='tempest-keypair-1204763740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e330da770824aad9f8e6c1e312c2e5b',ramdisk_id='',reservation_id='r-ppeoy8l7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2050584835',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2050584835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd323d14ebd4f418ef98952c0efbe29',uuid=98c33773-942b-422b-b4fd-a2b548260c09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "address": "fa:16:3e:6f:c7:ae", "network": {"id": "3bc44c82-a575-4e5c-8661-2411b93b96bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1450868802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e330da770824aad9f8e6c1e312c2e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c33f4e9-4c", "ovs_interfaceid": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Converting VIF {"id": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "address": "fa:16:3e:6f:c7:ae", "network": {"id": "3bc44c82-a575-4e5c-8661-2411b93b96bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1450868802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e330da770824aad9f8e6c1e312c2e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c33f4e9-4c", "ovs_interfaceid": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c7:ae,bridge_name='br-int',has_traffic_filtering=True,id=8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9,network=Network(3bc44c82-a575-4e5c-8661-2411b93b96bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c33f4e9-4c') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.objects.instance [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lazy-loading 'pci_devices' on Instance uuid 98c33773-942b-422b-b4fd-a2b548260c09 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:36:45 user nova-compute[75018]:   <uuid>98c33773-942b-422b-b4fd-a2b548260c09</uuid>
Nov 07 15:36:45 user nova-compute[75018]:   <name>instance-0000001e</name>
Nov 07 15:36:45 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:36:45 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:36:45 user nova-compute[75018]:   <metadata>
Nov 07 15:36:45 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:36:45 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:36:45 user nova-compute[75018]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2021335938</nova:name>
Nov 07 15:36:45 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:36:45</nova:creationTime>
Nov 07 15:36:45 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:36:45 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:36:45 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:36:45 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:36:45 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:36:45 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:36:45 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:36:45 user nova-compute[75018]:       <nova:owner>
Nov 07 15:36:45 user nova-compute[75018]:         <nova:user uuid="5dd323d14ebd4f418ef98952c0efbe29">tempest-TestServerVolumeAttachmentScenario-2050584835-project-member</nova:user>
Nov 07 15:36:45 user nova-compute[75018]:         <nova:project uuid="3e330da770824aad9f8e6c1e312c2e5b">tempest-TestServerVolumeAttachmentScenario-2050584835</nova:project>
Nov 07 15:36:45 user nova-compute[75018]:       </nova:owner>
Nov 07 15:36:45 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:36:45 user nova-compute[75018]:       <nova:ports>
Nov 07 15:36:45 user nova-compute[75018]:         <nova:port uuid="8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9">
Nov 07 15:36:45 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 15:36:45 user nova-compute[75018]:         </nova:port>
Nov 07 15:36:45 user nova-compute[75018]:       </nova:ports>
Nov 07 15:36:45 user nova-compute[75018]:     </nova:instance>
Nov 07 15:36:45 user nova-compute[75018]:   </metadata>
Nov 07 15:36:45 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:36:45 user nova-compute[75018]:     <system>
Nov 07 15:36:45 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:36:45 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:36:45 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:36:45 user nova-compute[75018]:       <entry name="serial">98c33773-942b-422b-b4fd-a2b548260c09</entry>
Nov 07 15:36:45 user nova-compute[75018]:       <entry name="uuid">98c33773-942b-422b-b4fd-a2b548260c09</entry>
Nov 07 15:36:45 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:36:45 user nova-compute[75018]:     </system>
Nov 07 15:36:45 user nova-compute[75018]:   </sysinfo>
Nov 07 15:36:45 user nova-compute[75018]:   <os>
Nov 07 15:36:45 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:36:45 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:36:45 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:36:45 user nova-compute[75018]:   </os>
Nov 07 15:36:45 user nova-compute[75018]:   <features>
Nov 07 15:36:45 user nova-compute[75018]:     <acpi/>
Nov 07 15:36:45 user nova-compute[75018]:     <apic/>
Nov 07 15:36:45 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:36:45 user nova-compute[75018]:   </features>
Nov 07 15:36:45 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:36:45 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:36:45 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:36:45 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:36:45 user nova-compute[75018]:   </clock>
Nov 07 15:36:45 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:36:45 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:36:45 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:36:45 user nova-compute[75018]:   </cpu>
Nov 07 15:36:45 user nova-compute[75018]:   <devices>
Nov 07 15:36:45 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:36:45 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:36:45 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk"/>
Nov 07 15:36:45 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:36:45 user nova-compute[75018]:     </disk>
Nov 07 15:36:45 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:36:45 user nova-compute[75018]:       <mac address="fa:16:3e:6f:c7:ae"/>
Nov 07 15:36:45 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:36:45 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:36:45 user nova-compute[75018]:       <target dev="tap8c33f4e9-4c"/>
Nov 07 15:36:45 user nova-compute[75018]:     </interface>
Nov 07 15:36:45 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:36:45 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/console.log" append="off"/>
Nov 07 15:36:45 user nova-compute[75018]:     </serial>
Nov 07 15:36:45 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:36:45 user nova-compute[75018]:     <video>
Nov 07 15:36:45 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:36:45 user nova-compute[75018]:     </video>
Nov 07 15:36:45 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:36:45 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:36:45 user nova-compute[75018]:     </rng>
Nov 07 15:36:45 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:36:45 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:36:45 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:36:45 user nova-compute[75018]:     </memballoon>
Nov 07 15:36:45 user nova-compute[75018]:   </devices>
Nov 07 15:36:45 user nova-compute[75018]: </domain>
Nov 07 15:36:45 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:36:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2021335938',display_name='tempest-TestServerVolumeAttachmentScenario-server-2021335938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2021335938',id=30,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj6Lb+MDuLa2Cb3vOfLTbl8R5ZeB/z2uueEZdRiotCU45FfL7/xTRsyITLx1f8WgOj5GYxNRza5+/FwcsueVKsmOmBYHAmS+SHBEUk04JxN3NMWYxgsZXjYg5qfAeKmGw==',key_name='tempest-keypair-1204763740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e330da770824aad9f8e6c1e312c2e5b',ramdisk_id='',reservation_id='r-ppeoy8l7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2050584835',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2050584835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd323d14ebd4f418ef98952c0efbe29',uuid=98c33773-942b-422b-b4fd-a2b548260c09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "address": "fa:16:3e:6f:c7:ae", "network": {"id": "3bc44c82-a575-4e5c-8661-2411b93b96bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1450868802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e330da770824aad9f8e6c1e312c2e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c33f4e9-4c", "ovs_interfaceid": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Converting VIF {"id": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "address": "fa:16:3e:6f:c7:ae", "network": {"id": "3bc44c82-a575-4e5c-8661-2411b93b96bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1450868802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e330da770824aad9f8e6c1e312c2e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c33f4e9-4c", "ovs_interfaceid": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c7:ae,bridge_name='br-int',has_traffic_filtering=True,id=8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9,network=Network(3bc44c82-a575-4e5c-8661-2411b93b96bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c33f4e9-4c') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG os_vif [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c7:ae,bridge_name='br-int',has_traffic_filtering=True,id=8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9,network=Network(3bc44c82-a575-4e5c-8661-2411b93b96bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c33f4e9-4c') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c10717cf-0159-5bb0-872f-642c54213d41', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c33f4e9-4c, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c33f4e9-4c, col_values=(('qos', UUID('1fb3f3ae-9ed0-45cc-b743-46782bbbb259')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c33f4e9-4c, col_values=(('external_ids', {'iface-id': '8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:c7:ae', 'vm-uuid': '98c33773-942b-422b-b4fd-a2b548260c09'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:45 user nova-compute[75018]: INFO os_vif [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c7:ae,bridge_name='br-int',has_traffic_filtering=True,id=8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9,network=Network(3bc44c82-a575-4e5c-8661-2411b93b96bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c33f4e9-4c')
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:36:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] No VIF found with MAC fa:16:3e:6f:c7:ae, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:36:46 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:36:46 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:36:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.549s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:46 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Deleted allocations for instance 2fc7eecf-a7a9-410b-83d4-1cb15542aea2
Nov 07 15:36:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0595d8ab-bcb7-46c1-87ee-0ec122deac98 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "2fc7eecf-a7a9-410b-83d4-1cb15542aea2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.632s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:46 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:36:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:36:46 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Instance spawned successfully.
Nov 07 15:36:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:36:47 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Instance spawned successfully.
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:36:47 user nova-compute[75018]: INFO nova.compute.manager [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Took 8.03 seconds to spawn the instance on the hypervisor.
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:36:47 user nova-compute[75018]: INFO nova.compute.manager [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Took 10.95 seconds to spawn the instance on the hypervisor.
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:36:47 user nova-compute[75018]: INFO nova.compute.manager [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Took 9.60 seconds to build instance.
Nov 07 15:36:47 user nova-compute[75018]: INFO nova.compute.manager [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Took 12.31 seconds to build instance.
Nov 07 15:36:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0629414b-6322-4f5d-bda1-2f5df3eff0bb tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "374fbc2b-2e56-454e-a661-89c94af582ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.718s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e8dc7718-dd42-4eb0-9e69-7f18662a9818 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.438s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-c32b3596-add4-44f3-a036-e109aa5c4a05 req-89e4f2cb-f422-49e9-862a-9ba1ba009846 service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Received event network-vif-plugged-27e0ec73-3d90-434e-a755-47b5778359c0 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c32b3596-add4-44f3-a036-e109aa5c4a05 req-89e4f2cb-f422-49e9-862a-9ba1ba009846 service nova] Acquiring lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c32b3596-add4-44f3-a036-e109aa5c4a05 req-89e4f2cb-f422-49e9-862a-9ba1ba009846 service nova] Lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c32b3596-add4-44f3-a036-e109aa5c4a05 req-89e4f2cb-f422-49e9-862a-9ba1ba009846 service nova] Lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-c32b3596-add4-44f3-a036-e109aa5c4a05 req-89e4f2cb-f422-49e9-862a-9ba1ba009846 service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] No waiting events found dispatching network-vif-plugged-27e0ec73-3d90-434e-a755-47b5778359c0 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:47 user nova-compute[75018]: WARNING nova.compute.manager [req-c32b3596-add4-44f3-a036-e109aa5c4a05 req-89e4f2cb-f422-49e9-862a-9ba1ba009846 service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Received unexpected event network-vif-plugged-27e0ec73-3d90-434e-a755-47b5778359c0 for instance with vm_state active and task_state None.
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-565ac20f-3602-4c9a-8854-58e25e5f2ae7 req-e23ce37a-9f2f-45c3-a7e9-65bcde9b6e5b service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Received event network-vif-plugged-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-565ac20f-3602-4c9a-8854-58e25e5f2ae7 req-e23ce37a-9f2f-45c3-a7e9-65bcde9b6e5b service nova] Acquiring lock "98c33773-942b-422b-b4fd-a2b548260c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-565ac20f-3602-4c9a-8854-58e25e5f2ae7 req-e23ce37a-9f2f-45c3-a7e9-65bcde9b6e5b service nova] Lock "98c33773-942b-422b-b4fd-a2b548260c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-565ac20f-3602-4c9a-8854-58e25e5f2ae7 req-e23ce37a-9f2f-45c3-a7e9-65bcde9b6e5b service nova] Lock "98c33773-942b-422b-b4fd-a2b548260c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-565ac20f-3602-4c9a-8854-58e25e5f2ae7 req-e23ce37a-9f2f-45c3-a7e9-65bcde9b6e5b service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] No waiting events found dispatching network-vif-plugged-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:47 user nova-compute[75018]: WARNING nova.compute.manager [req-565ac20f-3602-4c9a-8854-58e25e5f2ae7 req-e23ce37a-9f2f-45c3-a7e9-65bcde9b6e5b service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Received unexpected event network-vif-plugged-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 for instance with vm_state building and task_state spawning.
Nov 07 15:36:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:48 user nova-compute[75018]: INFO nova.compute.manager [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Terminating instance
Nov 07 15:36:48 user nova-compute[75018]: DEBUG nova.compute.manager [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:36:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:49 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Instance destroyed successfully.
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.objects.instance [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lazy-loading 'resources' on Instance uuid ec5ab630-cd90-4514-aa9c-e46efc0bf78a {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T15:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-517169496',display_name='tempest-ServerActionsTestOtherA-server-73412978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-517169496',id=21,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1ib+IZkBUNZq/XSdHL5Mc3rWOjMKRZFDEv86GX4KYwSkRk0NwDBdXdk6iDYaPUir2kHQPF7s/yHU1b885XgqSAd/BtsiAhqj5T9Mo8OTRLSnj98TUeFLSeVstXTuztMA==',key_name='tempest-keypair-1509984004',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:33:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-wrpoydl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:33:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=ec5ab630-cd90-4514-aa9c-e46efc0bf78a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "340a2fcc-5b10-40db-90d7-646e5d265735", "address": "fa:16:3e:0e:3b:23", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap340a2fcc-5b", "ovs_interfaceid": "340a2fcc-5b10-40db-90d7-646e5d265735", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=340a2fcc-5b10-40db-90d7-646e5d265735,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340a2fcc-5b') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG os_vif [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=340a2fcc-5b10-40db-90d7-646e5d265735,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340a2fcc-5b') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap340a2fcc-5b, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63a91841-aaab-437e-8979-7a0ad1722164) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:49 user nova-compute[75018]: INFO os_vif [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=340a2fcc-5b10-40db-90d7-646e5d265735,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap340a2fcc-5b')
Nov 07 15:36:49 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Deleting instance files /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a_del
Nov 07 15:36:49 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Deletion of /opt/stack/data/nova/instances/ec5ab630-cd90-4514-aa9c-e46efc0bf78a_del complete
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "4bf14e55-beb3-4800-8472-3436fa21b45e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.compute.manager [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:49 user nova-compute[75018]: INFO nova.compute.manager [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:36:49 user nova-compute[75018]: INFO nova.compute.claims [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Claim successful on node user
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Received event network-vif-plugged-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] Acquiring lock "98c33773-942b-422b-b4fd-a2b548260c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] Lock "98c33773-942b-422b-b4fd-a2b548260c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] Lock "98c33773-942b-422b-b4fd-a2b548260c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] No waiting events found dispatching network-vif-plugged-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:49 user nova-compute[75018]: WARNING nova.compute.manager [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Received unexpected event network-vif-plugged-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 for instance with vm_state building and task_state spawning.
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-vif-unplugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] No waiting events found dispatching network-vif-unplugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-vif-unplugged-340a2fcc-5b10-40db-90d7-646e5d265735 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] No waiting events found dispatching network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:49 user nova-compute[75018]: WARNING nova.compute.manager [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received unexpected event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 for instance with vm_state active and task_state deleting.
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] No waiting events found dispatching network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:49 user nova-compute[75018]: WARNING nova.compute.manager [req-50993513-e66b-42a6-919d-e02c1c9a6e7f req-8a5f6f00-8163-4c26-8555-d29ebb7f0162 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received unexpected event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 for instance with vm_state active and task_state deleting.
Nov 07 15:36:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:36:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Instance spawned successfully.
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:50 user nova-compute[75018]: INFO nova.compute.manager [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Took 8.92 seconds to spawn the instance on the hypervisor.
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:36:50 user nova-compute[75018]: INFO nova.compute.manager [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Took 10.30 seconds to build instance.
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0c925d9-8d93-4e85-b809-cce78cec5e9e tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.633s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.947s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:36:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:36:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG nova.policy [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ae23950e1e84c9693f8098c270ecb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772e759d9a1d4d18ae43f53c731f87f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:36:51 user nova-compute[75018]: INFO nova.virt.block_device [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Booting with volume d6b61808-9e09-4193-aa84-dcddd725a823 at /dev/vda
Nov 07 15:36:51 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:36:51 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Took 1.36 seconds to deallocate network for instance.
Nov 07 15:36:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-a54cf8b1-2556-4f99-809f-d9affa5de398 req-b57fd3df-6579-40a9-92db-c7791940b8a7 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-vif-deleted-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:51 user nova-compute[75018]: INFO nova.compute.manager [req-a54cf8b1-2556-4f99-809f-d9affa5de398 req-b57fd3df-6579-40a9-92db-c7791940b8a7 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Neutron deleted interface 340a2fcc-5b10-40db-90d7-646e5d265735; detaching it from the instance and deleting it from the info cache
Nov 07 15:36:51 user nova-compute[75018]: DEBUG nova.network.neutron [req-a54cf8b1-2556-4f99-809f-d9affa5de398 req-b57fd3df-6579-40a9-92db-c7791940b8a7 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG os_brick.utils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-a54cf8b1-2556-4f99-809f-d9affa5de398 req-b57fd3df-6579-40a9-92db-c7791940b8a7 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Detach interface failed, port_id=340a2fcc-5b10-40db-90d7-646e5d265735, reason: Instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd55c897-95af-4b3d-942c-22b04c97175b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba92b76-245c-4b74-b891-0e5eef3dc8c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[197bfe4e-507b-4831-b03c-87a03900dda4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6a6a10-5ab4-449e-87d0-bd86d1f1d286]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:36:51 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c248f83-598a-45a0-8fe0-11ce251f531c]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG os_brick.utils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Updating existing volume attachment record: 0f716dd1-27ac-4c94-8c3b-795a7e20b9f1 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:36:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:51 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Deleted allocations for instance ec5ab630-cd90-4514-aa9c-e46efc0bf78a
Nov 07 15:36:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] No waiting events found dispatching network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:52 user nova-compute[75018]: WARNING nova.compute.manager [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received unexpected event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 for instance with vm_state deleted and task_state None.
Nov 07 15:36:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-vif-unplugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] No waiting events found dispatching network-vif-unplugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:52 user nova-compute[75018]: WARNING nova.compute.manager [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received unexpected event network-vif-unplugged-340a2fcc-5b10-40db-90d7-646e5d265735 for instance with vm_state deleted and task_state None.
Nov 07 15:36:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] Acquiring lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] No waiting events found dispatching network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:52 user nova-compute[75018]: WARNING nova.compute.manager [req-86175b66-5949-44aa-901f-b9785981683e req-58ad3d49-0f56-467f-bd8b-955a87cc1999 service nova] [instance: ec5ab630-cd90-4514-aa9c-e46efc0bf78a] Received unexpected event network-vif-plugged-340a2fcc-5b10-40db-90d7-646e5d265735 for instance with vm_state deleted and task_state None.
Nov 07 15:36:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2117d3de-0193-497c-8af0-2c8a2950e78c tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "ec5ab630-cd90-4514-aa9c-e46efc0bf78a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.428s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Successfully created port: fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:36:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Successfully updated port: fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:36:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "refresh_cache-4bf14e55-beb3-4800-8472-3436fa21b45e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:36:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquired lock "refresh_cache-4bf14e55-beb3-4800-8472-3436fa21b45e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:36:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:36:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:36:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-7a3e850a-2eb7-41db-ac93-23b38a3555ca req-ac257d94-e2fd-4b33-a97d-83606ac8b35f service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Received event network-changed-fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-7a3e850a-2eb7-41db-ac93-23b38a3555ca req-ac257d94-e2fd-4b33-a97d-83606ac8b35f service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Refreshing instance network info cache due to event network-changed-fb52e207-387c-43d0-9382-dcde18f34a8e. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:36:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7a3e850a-2eb7-41db-ac93-23b38a3555ca req-ac257d94-e2fd-4b33-a97d-83606ac8b35f service nova] Acquiring lock "refresh_cache-4bf14e55-beb3-4800-8472-3436fa21b45e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:36:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Updating instance_info_cache with network_info: [{"id": "fb52e207-387c-43d0-9382-dcde18f34a8e", "address": "fa:16:3e:87:db:1b", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e207-38", "ovs_interfaceid": "fb52e207-387c-43d0-9382-dcde18f34a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:36:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Releasing lock "refresh_cache-4bf14e55-beb3-4800-8472-3436fa21b45e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:36:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Instance network_info: |[{"id": "fb52e207-387c-43d0-9382-dcde18f34a8e", "address": "fa:16:3e:87:db:1b", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e207-38", "ovs_interfaceid": "fb52e207-387c-43d0-9382-dcde18f34a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:36:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7a3e850a-2eb7-41db-ac93-23b38a3555ca req-ac257d94-e2fd-4b33-a97d-83606ac8b35f service nova] Acquired lock "refresh_cache-4bf14e55-beb3-4800-8472-3436fa21b45e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:36:53 user nova-compute[75018]: DEBUG nova.network.neutron [req-7a3e850a-2eb7-41db-ac93-23b38a3555ca req-ac257d94-e2fd-4b33-a97d-83606ac8b35f service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Refreshing network info cache for port fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:36:54 user nova-compute[75018]: DEBUG nova.network.neutron [req-7a3e850a-2eb7-41db-ac93-23b38a3555ca req-ac257d94-e2fd-4b33-a97d-83606ac8b35f service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Updated VIF entry in instance network info cache for port fb52e207-387c-43d0-9382-dcde18f34a8e. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:36:54 user nova-compute[75018]: DEBUG nova.network.neutron [req-7a3e850a-2eb7-41db-ac93-23b38a3555ca req-ac257d94-e2fd-4b33-a97d-83606ac8b35f service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Updating instance_info_cache with network_info: [{"id": "fb52e207-387c-43d0-9382-dcde18f34a8e", "address": "fa:16:3e:87:db:1b", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e207-38", "ovs_interfaceid": "fb52e207-387c-43d0-9382-dcde18f34a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:36:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7a3e850a-2eb7-41db-ac93-23b38a3555ca req-ac257d94-e2fd-4b33-a97d-83606ac8b35f service nova] Releasing lock "refresh_cache-4bf14e55-beb3-4800-8472-3436fa21b45e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:36:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "fd9de68b-2c19-498a-866d-f68848b2c5c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "fd9de68b-2c19-498a-866d-f68848b2c5c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.009s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.005s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:58 user nova-compute[75018]: INFO nova.compute.manager [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Terminating instance
Nov 07 15:36:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-a17e10c9-312c-4e3e-b2c2-827fbaed17ad req-8c7a0de0-a9c2-485a-a255-5ff828d0fa36 service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Received event network-vif-unplugged-19eb661e-ec41-4241-b20b-c19787e62999 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a17e10c9-312c-4e3e-b2c2-827fbaed17ad req-8c7a0de0-a9c2-485a-a255-5ff828d0fa36 service nova] Acquiring lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a17e10c9-312c-4e3e-b2c2-827fbaed17ad req-8c7a0de0-a9c2-485a-a255-5ff828d0fa36 service nova] Lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a17e10c9-312c-4e3e-b2c2-827fbaed17ad req-8c7a0de0-a9c2-485a-a255-5ff828d0fa36 service nova] Lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-a17e10c9-312c-4e3e-b2c2-827fbaed17ad req-8c7a0de0-a9c2-485a-a255-5ff828d0fa36 service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] No waiting events found dispatching network-vif-unplugged-19eb661e-ec41-4241-b20b-c19787e62999 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:36:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-a17e10c9-312c-4e3e-b2c2-827fbaed17ad req-8c7a0de0-a9c2-485a-a255-5ff828d0fa36 service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Received event network-vif-unplugged-19eb661e-ec41-4241-b20b-c19787e62999 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:36:59 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Instance destroyed successfully.
Nov 07 15:36:59 user nova-compute[75018]: DEBUG nova.objects.instance [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lazy-loading 'resources' on Instance uuid fd9de68b-2c19-498a-866d-f68848b2c5c7 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-476100364',display_name='tempest-VolumesActionsTest-instance-476100364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-476100364',id=27,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:35:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4f5f1be50a349608f65cc66956cce7d',ramdisk_id='',reservation_id='r-cio0ui9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1647501759',owner_user_name='tempest-VolumesActionsTest-1647501759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:35:16Z,user_data=None,user_id='6258fd6050d241f49713a0a788f79aa0',uuid=fd9de68b-2c19-498a-866d-f68848b2c5c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19eb661e-ec41-4241-b20b-c19787e62999", "address": "fa:16:3e:e4:0c:57", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19eb661e-ec", "ovs_interfaceid": "19eb661e-ec41-4241-b20b-c19787e62999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Converting VIF {"id": "19eb661e-ec41-4241-b20b-c19787e62999", "address": "fa:16:3e:e4:0c:57", "network": {"id": "9c06cf86-20ca-42bb-b009-18115bbbc97d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115724402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4f5f1be50a349608f65cc66956cce7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19eb661e-ec", "ovs_interfaceid": "19eb661e-ec41-4241-b20b-c19787e62999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0c:57,bridge_name='br-int',has_traffic_filtering=True,id=19eb661e-ec41-4241-b20b-c19787e62999,network=Network(9c06cf86-20ca-42bb-b009-18115bbbc97d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19eb661e-ec') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG os_vif [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0c:57,bridge_name='br-int',has_traffic_filtering=True,id=19eb661e-ec41-4241-b20b-c19787e62999,network=Network(9c06cf86-20ca-42bb-b009-18115bbbc97d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19eb661e-ec') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19eb661e-ec, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2bc15b6-a49d-482f-a85d-a1b261e20cc8) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:36:59 user nova-compute[75018]: INFO os_vif [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0c:57,bridge_name='br-int',has_traffic_filtering=True,id=19eb661e-ec41-4241-b20b-c19787e62999,network=Network(9c06cf86-20ca-42bb-b009-18115bbbc97d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19eb661e-ec')
Nov 07 15:36:59 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Deleting instance files /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7_del
Nov 07 15:36:59 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Deletion of /opt/stack/data/nova/instances/fd9de68b-2c19-498a-866d-f68848b2c5c7_del complete
Nov 07 15:36:59 user nova-compute[75018]: INFO nova.compute.manager [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Took 0.80 seconds to destroy the instance on the hypervisor.
Nov 07 15:36:59 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:36:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-fb837803-5617-4518-a447-c8346b30c6f8 req-1fd49a1e-b9d3-48de-910a-ac9159735e5a service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Received event network-vif-deleted-19eb661e-ec41-4241-b20b-c19787e62999 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:36:59 user nova-compute[75018]: INFO nova.compute.manager [req-fb837803-5617-4518-a447-c8346b30c6f8 req-1fd49a1e-b9d3-48de-910a-ac9159735e5a service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Neutron deleted interface 19eb661e-ec41-4241-b20b-c19787e62999; detaching it from the instance and deleting it from the info cache
Nov 07 15:36:59 user nova-compute[75018]: DEBUG nova.network.neutron [req-fb837803-5617-4518-a447-c8346b30c6f8 req-1fd49a1e-b9d3-48de-910a-ac9159735e5a service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:36:59 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Took 0.69 seconds to deallocate network for instance.
Nov 07 15:37:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-fb837803-5617-4518-a447-c8346b30c6f8 req-1fd49a1e-b9d3-48de-910a-ac9159735e5a service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Detach interface failed, port_id=19eb661e-ec41-4241-b20b-c19787e62999, reason: Instance fd9de68b-2c19-498a-866d-f68848b2c5c7 could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:37:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:00 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:37:00 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:37:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:00 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Deleted allocations for instance fd9de68b-2c19-498a-866d-f68848b2c5c7
Nov 07 15:37:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e0a22711-3e88-4876-8e1b-6a187d3094d7 tempest-VolumesActionsTest-1647501759 tempest-VolumesActionsTest-1647501759-project-member] Lock "fd9de68b-2c19-498a-866d-f68848b2c5c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.160s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-377ad1e7-aa2c-4123-b1dd-051cca5477e4 req-2e613fed-dc63-4858-8259-9f6fdb59fca7 service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Received event network-vif-plugged-19eb661e-ec41-4241-b20b-c19787e62999 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:37:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-377ad1e7-aa2c-4123-b1dd-051cca5477e4 req-2e613fed-dc63-4858-8259-9f6fdb59fca7 service nova] Acquiring lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-377ad1e7-aa2c-4123-b1dd-051cca5477e4 req-2e613fed-dc63-4858-8259-9f6fdb59fca7 service nova] Lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-377ad1e7-aa2c-4123-b1dd-051cca5477e4 req-2e613fed-dc63-4858-8259-9f6fdb59fca7 service nova] Lock "fd9de68b-2c19-498a-866d-f68848b2c5c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-377ad1e7-aa2c-4123-b1dd-051cca5477e4 req-2e613fed-dc63-4858-8259-9f6fdb59fca7 service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] No waiting events found dispatching network-vif-plugged-19eb661e-ec41-4241-b20b-c19787e62999 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:37:01 user nova-compute[75018]: WARNING nova.compute.manager [req-377ad1e7-aa2c-4123-b1dd-051cca5477e4 req-2e613fed-dc63-4858-8259-9f6fdb59fca7 service nova] [instance: fd9de68b-2c19-498a-866d-f68848b2c5c7] Received unexpected event network-vif-plugged-19eb661e-ec41-4241-b20b-c19787e62999 for instance with vm_state deleted and task_state None.
Nov 07 15:37:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:37:14 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Creating image(s)
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Did not create local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Ensure instance console log exists: /opt/stack/data/nova/instances/4bf14e55-beb3-4800-8472-3436fa21b45e/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Start _get_guest_xml network_info=[{"id": "fb52e207-387c-43d0-9382-dcde18f34a8e", "address": "fa:16:3e:87:db:1b", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e207-38", "ovs_interfaceid": "fb52e207-387c-43d0-9382-dcde18f34a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leNjJLXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4bf14e55-beb3-4800-8472-3436fa21b45e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6b61808-9e09-4193-aa84-dcddd725a823', 'serial': 'd6b61808-9e09-4193-aa84-dcddd725a823'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '0f716dd1-27ac-4c94-8c3b-795a7e20b9f1', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:37:14 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:37:14 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leNjJLXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:37:14 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:37:14 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:37:14 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3131d9-090c-45ab-a7d3-9ae24fbb57f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:37:14 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[606732fc-f3f1-4f38-8c78-0107ef137a82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823] added
Nov 07 15:37:14 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b43e84b-648e-4330-815e-a5c1a8282602]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a713641c-7f13-41a3-85be-5e34754613a2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v leNjJLXZ {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v leNjJLXZ" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f12853-f315-4f75-9d8f-302ac433068e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'leNjJLXZ'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.113s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acaf729-87f1-4f5a-94ef-6b7825d65eed]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2976b2-3bcb-481b-9943-478289958525]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 15:37:14 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 15:37:14 user nova-compute[75018]:  {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:37:14 user nova-compute[75018]: WARNING os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 15:37:14 user nova-compute[75018]: 
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[050862b0-7f8f-4993-9b46-cc9b54cbb4a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823, portal: 172.16.0.220,3260]
Nov 07 15:37:14 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823, portal: 172.16.0.220,3260] successful.
Nov 07 15:37:14 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[129d4ef4-f4dd-419f-b501-f5141fd67a6a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2468b9a4-5564-4552-ab58-261e4ca1dc11]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:37:14 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:37:14 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a50fa5d-01ff-42b7-8843-4b6bd6d9396a]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:37:14 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leNjJLXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26363626238323633', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363626238323633', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:36:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2113511336',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2113511336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2113511336',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9HhKgcHk/NT2mVzDJWzQtEE1JQawGHZhRXbtORdt+jyc5YQH7k8KoIlGtupQDNUP6Iad7DMyGmo1qmPXsuZ9l3eNIvyB2x9UsTMuGM2jpeXk9z5lwRerR82n947AWNjw==',key_name='tempest-keypair-393790816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772e759d9a1d4d18ae43f53c731f87f2',ramdisk_id='',reservation_id='r-axpvru6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1644595019',owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ae23950e1e84c9693f8098c270ecb55',uuid=4bf14e55-beb3-4800-8472-3436fa21b45e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb52e207-387c-43d0-9382-dcde18f34a8e", "address": "fa:16:3e:87:db:1b", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e207-38", "ovs_interfaceid": "fb52e207-387c-43d0-9382-dcde18f34a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converting VIF {"id": "fb52e207-387c-43d0-9382-dcde18f34a8e", "address": "fa:16:3e:87:db:1b", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e207-38", "ovs_interfaceid": "fb52e207-387c-43d0-9382-dcde18f34a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:db:1b,bridge_name='br-int',has_traffic_filtering=True,id=fb52e207-387c-43d0-9382-dcde18f34a8e,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb52e207-38') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG nova.objects.instance [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bf14e55-beb3-4800-8472-3436fa21b45e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:37:15 user nova-compute[75018]:   <uuid>4bf14e55-beb3-4800-8472-3436fa21b45e</uuid>
Nov 07 15:37:15 user nova-compute[75018]:   <name>instance-0000001f</name>
Nov 07 15:37:15 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:37:15 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:37:15 user nova-compute[75018]:   <metadata>
Nov 07 15:37:15 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:37:15 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:37:15 user nova-compute[75018]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2113511336</nova:name>
Nov 07 15:37:15 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:37:14</nova:creationTime>
Nov 07 15:37:15 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:37:15 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:37:15 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:37:15 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:37:15 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:37:15 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:37:15 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:37:15 user nova-compute[75018]:       <nova:owner>
Nov 07 15:37:15 user nova-compute[75018]:         <nova:user uuid="3ae23950e1e84c9693f8098c270ecb55">tempest-TestVolumeBootPattern-1644595019-project-member</nova:user>
Nov 07 15:37:15 user nova-compute[75018]:         <nova:project uuid="772e759d9a1d4d18ae43f53c731f87f2">tempest-TestVolumeBootPattern-1644595019</nova:project>
Nov 07 15:37:15 user nova-compute[75018]:       </nova:owner>
Nov 07 15:37:15 user nova-compute[75018]:       <nova:ports>
Nov 07 15:37:15 user nova-compute[75018]:         <nova:port uuid="fb52e207-387c-43d0-9382-dcde18f34a8e">
Nov 07 15:37:15 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 07 15:37:15 user nova-compute[75018]:         </nova:port>
Nov 07 15:37:15 user nova-compute[75018]:       </nova:ports>
Nov 07 15:37:15 user nova-compute[75018]:     </nova:instance>
Nov 07 15:37:15 user nova-compute[75018]:   </metadata>
Nov 07 15:37:15 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:37:15 user nova-compute[75018]:     <system>
Nov 07 15:37:15 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:37:15 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:37:15 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:37:15 user nova-compute[75018]:       <entry name="serial">4bf14e55-beb3-4800-8472-3436fa21b45e</entry>
Nov 07 15:37:15 user nova-compute[75018]:       <entry name="uuid">4bf14e55-beb3-4800-8472-3436fa21b45e</entry>
Nov 07 15:37:15 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:37:15 user nova-compute[75018]:     </system>
Nov 07 15:37:15 user nova-compute[75018]:   </sysinfo>
Nov 07 15:37:15 user nova-compute[75018]:   <os>
Nov 07 15:37:15 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:37:15 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:37:15 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:37:15 user nova-compute[75018]:   </os>
Nov 07 15:37:15 user nova-compute[75018]:   <features>
Nov 07 15:37:15 user nova-compute[75018]:     <acpi/>
Nov 07 15:37:15 user nova-compute[75018]:     <apic/>
Nov 07 15:37:15 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:37:15 user nova-compute[75018]:   </features>
Nov 07 15:37:15 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:37:15 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:37:15 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:37:15 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:37:15 user nova-compute[75018]:   </clock>
Nov 07 15:37:15 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:37:15 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:37:15 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:37:15 user nova-compute[75018]:   </cpu>
Nov 07 15:37:15 user nova-compute[75018]:   <devices>
Nov 07 15:37:15 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:37:15 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:37:15 user nova-compute[75018]:       <source dev="/dev/sdb"/>
Nov 07 15:37:15 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:37:15 user nova-compute[75018]:       <serial>d6b61808-9e09-4193-aa84-dcddd725a823</serial>
Nov 07 15:37:15 user nova-compute[75018]:     </disk>
Nov 07 15:37:15 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:37:15 user nova-compute[75018]:       <mac address="fa:16:3e:87:db:1b"/>
Nov 07 15:37:15 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:37:15 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:37:15 user nova-compute[75018]:       <target dev="tapfb52e207-38"/>
Nov 07 15:37:15 user nova-compute[75018]:     </interface>
Nov 07 15:37:15 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:37:15 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/4bf14e55-beb3-4800-8472-3436fa21b45e/console.log" append="off"/>
Nov 07 15:37:15 user nova-compute[75018]:     </serial>
Nov 07 15:37:15 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:37:15 user nova-compute[75018]:     <video>
Nov 07 15:37:15 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:37:15 user nova-compute[75018]:     </video>
Nov 07 15:37:15 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:37:15 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:37:15 user nova-compute[75018]:     </rng>
Nov 07 15:37:15 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:37:15 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:37:15 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:37:15 user nova-compute[75018]:     </memballoon>
Nov 07 15:37:15 user nova-compute[75018]:   </devices>
Nov 07 15:37:15 user nova-compute[75018]: </domain>
Nov 07 15:37:15 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:36:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2113511336',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2113511336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2113511336',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9HhKgcHk/NT2mVzDJWzQtEE1JQawGHZhRXbtORdt+jyc5YQH7k8KoIlGtupQDNUP6Iad7DMyGmo1qmPXsuZ9l3eNIvyB2x9UsTMuGM2jpeXk9z5lwRerR82n947AWNjw==',key_name='tempest-keypair-393790816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772e759d9a1d4d18ae43f53c731f87f2',ramdisk_id='',reservation_id='r-axpvru6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1644595019',owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ae23950e1e84c9693f8098c270ecb55',uuid=4bf14e55-beb3-4800-8472-3436fa21b45e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb52e207-387c-43d0-9382-dcde18f34a8e", "address": "fa:16:3e:87:db:1b", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e207-38", "ovs_interfaceid": "fb52e207-387c-43d0-9382-dcde18f34a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converting VIF {"id": "fb52e207-387c-43d0-9382-dcde18f34a8e", "address": "fa:16:3e:87:db:1b", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e207-38", "ovs_interfaceid": "fb52e207-387c-43d0-9382-dcde18f34a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:db:1b,bridge_name='br-int',has_traffic_filtering=True,id=fb52e207-387c-43d0-9382-dcde18f34a8e,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb52e207-38') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG os_vif [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:db:1b,bridge_name='br-int',has_traffic_filtering=True,id=fb52e207-387c-43d0-9382-dcde18f34a8e,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb52e207-38') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f61569f7-193d-5a84-a645-1ade26a4d418', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb52e207-38, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb52e207-38, col_values=(('qos', UUID('9ded4f5d-0eaf-4e48-b293-f71c75aa0c8a')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb52e207-38, col_values=(('external_ids', {'iface-id': 'fb52e207-387c-43d0-9382-dcde18f34a8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:db:1b', 'vm-uuid': '4bf14e55-beb3-4800-8472-3436fa21b45e'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:15 user nova-compute[75018]: INFO os_vif [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:db:1b,bridge_name='br-int',has_traffic_filtering=True,id=fb52e207-387c-43d0-9382-dcde18f34a8e,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb52e207-38')
Nov 07 15:37:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] No VIF found with MAC fa:16:3e:87:db:1b, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:37:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:17 user nova-compute[75018]: DEBUG nova.compute.manager [req-7a30ae5f-4d38-4b9d-a315-36aac0ecc3bd req-50aadef5-c19a-4bb1-9311-8e77ff921597 service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Received event network-vif-plugged-fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:37:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7a30ae5f-4d38-4b9d-a315-36aac0ecc3bd req-50aadef5-c19a-4bb1-9311-8e77ff921597 service nova] Acquiring lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7a30ae5f-4d38-4b9d-a315-36aac0ecc3bd req-50aadef5-c19a-4bb1-9311-8e77ff921597 service nova] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7a30ae5f-4d38-4b9d-a315-36aac0ecc3bd req-50aadef5-c19a-4bb1-9311-8e77ff921597 service nova] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:17 user nova-compute[75018]: DEBUG nova.compute.manager [req-7a30ae5f-4d38-4b9d-a315-36aac0ecc3bd req-50aadef5-c19a-4bb1-9311-8e77ff921597 service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] No waiting events found dispatching network-vif-plugged-fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:37:17 user nova-compute[75018]: WARNING nova.compute.manager [req-7a30ae5f-4d38-4b9d-a315-36aac0ecc3bd req-50aadef5-c19a-4bb1-9311-8e77ff921597 service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Received unexpected event network-vif-plugged-fb52e207-387c-43d0-9382-dcde18f34a8e for instance with vm_state building and task_state spawning.
Nov 07 15:37:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:19 user nova-compute[75018]: DEBUG nova.compute.manager [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:37:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:37:19 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Instance spawned successfully.
Nov 07 15:37:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:37:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:37:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:37:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:37:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:37:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:37:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:37:19 user nova-compute[75018]: DEBUG nova.compute.manager [req-c49d1a70-7543-48ff-8a31-03e5b48ae680 req-c7a29339-edd7-4469-9cce-64da6cf33a8e service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Received event network-vif-plugged-fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:37:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c49d1a70-7543-48ff-8a31-03e5b48ae680 req-c7a29339-edd7-4469-9cce-64da6cf33a8e service nova] Acquiring lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c49d1a70-7543-48ff-8a31-03e5b48ae680 req-c7a29339-edd7-4469-9cce-64da6cf33a8e service nova] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c49d1a70-7543-48ff-8a31-03e5b48ae680 req-c7a29339-edd7-4469-9cce-64da6cf33a8e service nova] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:19 user nova-compute[75018]: DEBUG nova.compute.manager [req-c49d1a70-7543-48ff-8a31-03e5b48ae680 req-c7a29339-edd7-4469-9cce-64da6cf33a8e service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] No waiting events found dispatching network-vif-plugged-fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:37:19 user nova-compute[75018]: WARNING nova.compute.manager [req-c49d1a70-7543-48ff-8a31-03e5b48ae680 req-c7a29339-edd7-4469-9cce-64da6cf33a8e service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Received unexpected event network-vif-plugged-fb52e207-387c-43d0-9382-dcde18f34a8e for instance with vm_state building and task_state spawning.
Nov 07 15:37:19 user nova-compute[75018]: INFO nova.compute.manager [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 07 15:37:19 user nova-compute[75018]: DEBUG nova.compute.manager [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:37:19 user nova-compute[75018]: INFO nova.compute.manager [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Took 29.57 seconds to build instance.
Nov 07 15:37:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6c945306-0bf1-4b34-bfe2-d4300d570d4d tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.716s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:23 user nova-compute[75018]: INFO nova.compute.manager [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Terminating instance
Nov 07 15:37:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:37:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-bc299f04-5c63-424c-8c11-3f79cac1347b req-141e8e99-65e8-4a55-b061-859a373c0b7c service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-vif-unplugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-bc299f04-5c63-424c-8c11-3f79cac1347b req-141e8e99-65e8-4a55-b061-859a373c0b7c service nova] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-bc299f04-5c63-424c-8c11-3f79cac1347b req-141e8e99-65e8-4a55-b061-859a373c0b7c service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-bc299f04-5c63-424c-8c11-3f79cac1347b req-141e8e99-65e8-4a55-b061-859a373c0b7c service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-bc299f04-5c63-424c-8c11-3f79cac1347b req-141e8e99-65e8-4a55-b061-859a373c0b7c service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] No waiting events found dispatching network-vif-unplugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-bc299f04-5c63-424c-8c11-3f79cac1347b req-141e8e99-65e8-4a55-b061-859a373c0b7c service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-vif-unplugged-305ed47b-06ed-48aa-9584-70e46a35bded for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:37:24 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Instance destroyed successfully.
Nov 07 15:37:24 user nova-compute[75018]: DEBUG nova.objects.instance [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'resources' on Instance uuid af83bfa8-3661-4456-8854-f6c457e149fa {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-986489796',display_name='tempest-AttachVolumeTestJSON-server-986489796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-986489796',id=16,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0hEy6Pitp5/KtTEnBNkgUOns4w4ZMcmpTxmXDQ4xItuv4tIAT4CtKyRNJPdDjMXKTP3ENKo04CbmAPNdTPLrhWCvD73ElO9TJ8YQaIuoQSR42PL5M7RpYpZUxIXnp/KA==',key_name='tempest-keypair-1896323243',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:26:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='393342d93e71462eba531f173860d59f',ramdisk_id='',reservation_id='r-6g6bfllt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1503001538',owner_user_name='tempest-AttachVolumeTestJSON-1503001538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:35:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8af061ec9b2444ecbbc2d1ef913fe558',uuid=af83bfa8-3661-4456-8854-f6c457e149fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converting VIF {"id": "305ed47b-06ed-48aa-9584-70e46a35bded", "address": "fa:16:3e:f8:80:43", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305ed47b-06", "ovs_interfaceid": "305ed47b-06ed-48aa-9584-70e46a35bded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG os_vif [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap305ed47b-06, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70a6c002-3b46-46fc-9243-15ceb7056280) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:24 user nova-compute[75018]: INFO os_vif [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:80:43,bridge_name='br-int',has_traffic_filtering=True,id=305ed47b-06ed-48aa-9584-70e46a35bded,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305ed47b-06')
Nov 07 15:37:24 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Deleting instance files /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa_del
Nov 07 15:37:24 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Deletion of /opt/stack/data/nova/instances/af83bfa8-3661-4456-8854-f6c457e149fa_del complete
Nov 07 15:37:24 user nova-compute[75018]: INFO nova.compute.manager [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 07 15:37:24 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:37:24 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:37:25 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:37:25 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Took 0.88 seconds to deallocate network for instance.
Nov 07 15:37:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-d66e468d-bc05-4b4e-be78-b8cc76496275 req-1a3e705b-187c-4c92-8e46-e3757b96bb27 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-vif-deleted-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:37:25 user nova-compute[75018]: INFO nova.compute.manager [req-d66e468d-bc05-4b4e-be78-b8cc76496275 req-1a3e705b-187c-4c92-8e46-e3757b96bb27 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Neutron deleted interface 305ed47b-06ed-48aa-9584-70e46a35bded; detaching it from the instance and deleting it from the info cache
Nov 07 15:37:25 user nova-compute[75018]: DEBUG nova.network.neutron [req-d66e468d-bc05-4b4e-be78-b8cc76496275 req-1a3e705b-187c-4c92-8e46-e3757b96bb27 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:37:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-d66e468d-bc05-4b4e-be78-b8cc76496275 req-1a3e705b-187c-4c92-8e46-e3757b96bb27 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Detach interface failed, port_id=305ed47b-06ed-48aa-9584-70e46a35bded, reason: Instance af83bfa8-3661-4456-8854-f6c457e149fa could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:37:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:26 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:37:26 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:37:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:26 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Deleted allocations for instance af83bfa8-3661-4456-8854-f6c457e149fa
Nov 07 15:37:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0e2238fc-976c-4675-9883-92bf7a784654 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "af83bfa8-3661-4456-8854-f6c457e149fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.453s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:26 user nova-compute[75018]: DEBUG nova.compute.manager [req-ac9fc304-ca2e-46f9-a2e6-3c7d9f07cfda req-aa928365-05f9-4ffc-9672-bc294457d1b4 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:37:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ac9fc304-ca2e-46f9-a2e6-3c7d9f07cfda req-aa928365-05f9-4ffc-9672-bc294457d1b4 service nova] Acquiring lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ac9fc304-ca2e-46f9-a2e6-3c7d9f07cfda req-aa928365-05f9-4ffc-9672-bc294457d1b4 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ac9fc304-ca2e-46f9-a2e6-3c7d9f07cfda req-aa928365-05f9-4ffc-9672-bc294457d1b4 service nova] Lock "af83bfa8-3661-4456-8854-f6c457e149fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:26 user nova-compute[75018]: DEBUG nova.compute.manager [req-ac9fc304-ca2e-46f9-a2e6-3c7d9f07cfda req-aa928365-05f9-4ffc-9672-bc294457d1b4 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] No waiting events found dispatching network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:37:26 user nova-compute[75018]: WARNING nova.compute.manager [req-ac9fc304-ca2e-46f9-a2e6-3c7d9f07cfda req-aa928365-05f9-4ffc-9672-bc294457d1b4 service nova] [instance: af83bfa8-3661-4456-8854-f6c457e149fa] Received unexpected event network-vif-plugged-305ed47b-06ed-48aa-9584-70e46a35bded for instance with vm_state deleted and task_state None.
Nov 07 15:37:27 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:37:28 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:37:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:37:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:37:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:37:32 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:37:34 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:37:34 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:37:34 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 15:37:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:37:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:37:34 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:37:34 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid 0e508411-09db-48b8-98a5-1ccd9f4f6031 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:37:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:37:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:37:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:37:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:37:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:35 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updating instance_info_cache with network_info: [{"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:37:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:37:35 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:37:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:37:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:37 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:37:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:37:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:37:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:37:41 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:37:41 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:37:41 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7577MB free_disk=25.10982894897461GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:37:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:41 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:37:41 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:37:41 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:37:41 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 31e90a00-c2df-493c-9b7e-12d3063b877f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:37:41 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e4ad018d-bdc7-458b-9e77-ba31457e52ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:37:41 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 374fbc2b-2e56-454e-a661-89c94af582ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:37:41 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 98c33773-942b-422b-b4fd-a2b548260c09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:37:41 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 4bf14e55-beb3-4800-8472-3436fa21b45e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:37:41 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:37:41 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:37:42 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:37:42 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:37:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:37:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 0e508411-09db-48b8-98a5-1ccd9f4f6031 {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 626a4817-31f4-48c8-9ab6-07d539dd0a14 {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 31e90a00-c2df-493c-9b7e-12d3063b877f {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid e4ad018d-bdc7-458b-9e77-ba31457e52ff {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 374fbc2b-2e56-454e-a661-89c94af582ac {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 98c33773-942b-422b-b4fd-a2b548260c09 {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 4bf14e55-beb3-4800-8472-3436fa21b45e {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "0e508411-09db-48b8-98a5-1ccd9f4f6031" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "31e90a00-c2df-493c-9b7e-12d3063b877f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "374fbc2b-2e56-454e-a661-89c94af582ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "374fbc2b-2e56-454e-a661-89c94af582ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "98c33773-942b-422b-b4fd-a2b548260c09" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "98c33773-942b-422b-b4fd-a2b548260c09" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "4bf14e55-beb3-4800-8472-3436fa21b45e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "374fbc2b-2e56-454e-a661-89c94af582ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "98c33773-942b-422b-b4fd-a2b548260c09" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:37:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:37:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "1f86ee09-062b-428d-9870-14de77c569c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "1f86ee09-062b-428d-9870-14de77c569c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:38:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:00 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:38:00 user nova-compute[75018]: INFO nova.compute.claims [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Claim successful on node user
Nov 07 15:38:00 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:38:01 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:38:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG nova.policy [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ecef8d2ab1c490d98e9f65e16241cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d39d9835e04ea393a5c6ef8046aac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:38:01 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Creating image(s)
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "/opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "/opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk 1073741824" returned: 0 in 0.062s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Successfully created port: 58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.235s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:38:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Cannot resize image /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Ensure instance console log exists: /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Successfully updated port: 58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "refresh_cache-1f86ee09-062b-428d-9870-14de77c569c0" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquired lock "refresh_cache-1f86ee09-062b-428d-9870-14de77c569c0" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG nova.compute.manager [req-95fb0871-066f-4bbc-94c2-4505253649d9 req-6e33d955-b6c2-4cde-8478-410ccb3f75aa service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Received event network-changed-58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG nova.compute.manager [req-95fb0871-066f-4bbc-94c2-4505253649d9 req-6e33d955-b6c2-4cde-8478-410ccb3f75aa service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Refreshing instance network info cache due to event network-changed-58e42c23-4f3b-4394-aa4f-42ae19671af0. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-95fb0871-066f-4bbc-94c2-4505253649d9 req-6e33d955-b6c2-4cde-8478-410ccb3f75aa service nova] Acquiring lock "refresh_cache-1f86ee09-062b-428d-9870-14de77c569c0" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:38:02 user nova-compute[75018]: DEBUG nova.network.neutron [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Updating instance_info_cache with network_info: [{"id": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "address": "fa:16:3e:24:bd:89", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e42c23-4f", "ovs_interfaceid": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Releasing lock "refresh_cache-1f86ee09-062b-428d-9870-14de77c569c0" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Instance network_info: |[{"id": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "address": "fa:16:3e:24:bd:89", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e42c23-4f", "ovs_interfaceid": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-95fb0871-066f-4bbc-94c2-4505253649d9 req-6e33d955-b6c2-4cde-8478-410ccb3f75aa service nova] Acquired lock "refresh_cache-1f86ee09-062b-428d-9870-14de77c569c0" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.network.neutron [req-95fb0871-066f-4bbc-94c2-4505253649d9 req-6e33d955-b6c2-4cde-8478-410ccb3f75aa service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Refreshing network info cache for port 58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Start _get_guest_xml network_info=[{"id": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "address": "fa:16:3e:24:bd:89", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e42c23-4f", "ovs_interfaceid": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:38:03 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:38:03 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2126507144',display_name='tempest-VolumesSnapshotTestJSON-instance-2126507144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2126507144',id=32,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlY2/46CmIE9HAOg6uM47VamWHCN9jj5bRPiISK3bDDqPq0J7mD0y/J2EY3HTcjsLRVqTsTpeOsMB8zbNCoYL2SkDDA5oFbziEOhX5Xm6ZSUdutN07qDC27WqUm8g85vQ==',key_name='tempest-keypair-1976970800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d39d9835e04ea393a5c6ef8046aac2',ramdisk_id='',reservation_id='r-zpfj0kcj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-666600934',owner_user_name='tempest-VolumesSnapshotTestJSON-666600934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:38:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ecef8d2ab1c490d98e9f65e16241cf1',uuid=1f86ee09-062b-428d-9870-14de77c569c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "address": "fa:16:3e:24:bd:89", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e42c23-4f", "ovs_interfaceid": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Converting VIF {"id": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "address": "fa:16:3e:24:bd:89", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e42c23-4f", "ovs_interfaceid": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:bd:89,bridge_name='br-int',has_traffic_filtering=True,id=58e42c23-4f3b-4394-aa4f-42ae19671af0,network=Network(85503726-f3c9-4bad-958c-d4bade647236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e42c23-4f') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.objects.instance [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f86ee09-062b-428d-9870-14de77c569c0 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:38:03 user nova-compute[75018]:   <uuid>1f86ee09-062b-428d-9870-14de77c569c0</uuid>
Nov 07 15:38:03 user nova-compute[75018]:   <name>instance-00000020</name>
Nov 07 15:38:03 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:38:03 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:38:03 user nova-compute[75018]:   <metadata>
Nov 07 15:38:03 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:38:03 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:38:03 user nova-compute[75018]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2126507144</nova:name>
Nov 07 15:38:03 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:38:03</nova:creationTime>
Nov 07 15:38:03 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:38:03 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:38:03 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:38:03 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:38:03 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:38:03 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:38:03 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:38:03 user nova-compute[75018]:       <nova:owner>
Nov 07 15:38:03 user nova-compute[75018]:         <nova:user uuid="5ecef8d2ab1c490d98e9f65e16241cf1">tempest-VolumesSnapshotTestJSON-666600934-project-member</nova:user>
Nov 07 15:38:03 user nova-compute[75018]:         <nova:project uuid="d0d39d9835e04ea393a5c6ef8046aac2">tempest-VolumesSnapshotTestJSON-666600934</nova:project>
Nov 07 15:38:03 user nova-compute[75018]:       </nova:owner>
Nov 07 15:38:03 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:38:03 user nova-compute[75018]:       <nova:ports>
Nov 07 15:38:03 user nova-compute[75018]:         <nova:port uuid="58e42c23-4f3b-4394-aa4f-42ae19671af0">
Nov 07 15:38:03 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 15:38:03 user nova-compute[75018]:         </nova:port>
Nov 07 15:38:03 user nova-compute[75018]:       </nova:ports>
Nov 07 15:38:03 user nova-compute[75018]:     </nova:instance>
Nov 07 15:38:03 user nova-compute[75018]:   </metadata>
Nov 07 15:38:03 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:38:03 user nova-compute[75018]:     <system>
Nov 07 15:38:03 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:38:03 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:38:03 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:38:03 user nova-compute[75018]:       <entry name="serial">1f86ee09-062b-428d-9870-14de77c569c0</entry>
Nov 07 15:38:03 user nova-compute[75018]:       <entry name="uuid">1f86ee09-062b-428d-9870-14de77c569c0</entry>
Nov 07 15:38:03 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:38:03 user nova-compute[75018]:     </system>
Nov 07 15:38:03 user nova-compute[75018]:   </sysinfo>
Nov 07 15:38:03 user nova-compute[75018]:   <os>
Nov 07 15:38:03 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:38:03 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:38:03 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:38:03 user nova-compute[75018]:   </os>
Nov 07 15:38:03 user nova-compute[75018]:   <features>
Nov 07 15:38:03 user nova-compute[75018]:     <acpi/>
Nov 07 15:38:03 user nova-compute[75018]:     <apic/>
Nov 07 15:38:03 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:38:03 user nova-compute[75018]:   </features>
Nov 07 15:38:03 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:38:03 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:38:03 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:38:03 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:38:03 user nova-compute[75018]:   </clock>
Nov 07 15:38:03 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:38:03 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:38:03 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:38:03 user nova-compute[75018]:   </cpu>
Nov 07 15:38:03 user nova-compute[75018]:   <devices>
Nov 07 15:38:03 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:38:03 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:38:03 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk"/>
Nov 07 15:38:03 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:38:03 user nova-compute[75018]:     </disk>
Nov 07 15:38:03 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:38:03 user nova-compute[75018]:       <mac address="fa:16:3e:24:bd:89"/>
Nov 07 15:38:03 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:38:03 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:38:03 user nova-compute[75018]:       <target dev="tap58e42c23-4f"/>
Nov 07 15:38:03 user nova-compute[75018]:     </interface>
Nov 07 15:38:03 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:38:03 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/console.log" append="off"/>
Nov 07 15:38:03 user nova-compute[75018]:     </serial>
Nov 07 15:38:03 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:38:03 user nova-compute[75018]:     <video>
Nov 07 15:38:03 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:38:03 user nova-compute[75018]:     </video>
Nov 07 15:38:03 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:38:03 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:38:03 user nova-compute[75018]:     </rng>
Nov 07 15:38:03 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:38:03 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:38:03 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:38:03 user nova-compute[75018]:     </memballoon>
Nov 07 15:38:03 user nova-compute[75018]:   </devices>
Nov 07 15:38:03 user nova-compute[75018]: </domain>
Nov 07 15:38:03 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2126507144',display_name='tempest-VolumesSnapshotTestJSON-instance-2126507144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2126507144',id=32,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlY2/46CmIE9HAOg6uM47VamWHCN9jj5bRPiISK3bDDqPq0J7mD0y/J2EY3HTcjsLRVqTsTpeOsMB8zbNCoYL2SkDDA5oFbziEOhX5Xm6ZSUdutN07qDC27WqUm8g85vQ==',key_name='tempest-keypair-1976970800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d39d9835e04ea393a5c6ef8046aac2',ramdisk_id='',reservation_id='r-zpfj0kcj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-666600934',owner_user_name='tempest-VolumesSnapshotTestJSON-666600934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:38:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ecef8d2ab1c490d98e9f65e16241cf1',uuid=1f86ee09-062b-428d-9870-14de77c569c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "address": "fa:16:3e:24:bd:89", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e42c23-4f", "ovs_interfaceid": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Converting VIF {"id": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "address": "fa:16:3e:24:bd:89", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e42c23-4f", "ovs_interfaceid": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:bd:89,bridge_name='br-int',has_traffic_filtering=True,id=58e42c23-4f3b-4394-aa4f-42ae19671af0,network=Network(85503726-f3c9-4bad-958c-d4bade647236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e42c23-4f') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG os_vif [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:bd:89,bridge_name='br-int',has_traffic_filtering=True,id=58e42c23-4f3b-4394-aa4f-42ae19671af0,network=Network(85503726-f3c9-4bad-958c-d4bade647236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e42c23-4f') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dca2b254-865e-5db9-be14-dfe484755b3d', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58e42c23-4f, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58e42c23-4f, col_values=(('qos', UUID('88adb19c-6998-48ce-809a-f81a2e34a806')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58e42c23-4f, col_values=(('external_ids', {'iface-id': '58e42c23-4f3b-4394-aa4f-42ae19671af0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:bd:89', 'vm-uuid': '1f86ee09-062b-428d-9870-14de77c569c0'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:03 user nova-compute[75018]: INFO os_vif [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:bd:89,bridge_name='br-int',has_traffic_filtering=True,id=58e42c23-4f3b-4394-aa4f-42ae19671af0,network=Network(85503726-f3c9-4bad-958c-d4bade647236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e42c23-4f')
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] No VIF found with MAC fa:16:3e:24:bd:89, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.network.neutron [req-95fb0871-066f-4bbc-94c2-4505253649d9 req-6e33d955-b6c2-4cde-8478-410ccb3f75aa service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Updated VIF entry in instance network info cache for port 58e42c23-4f3b-4394-aa4f-42ae19671af0. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG nova.network.neutron [req-95fb0871-066f-4bbc-94c2-4505253649d9 req-6e33d955-b6c2-4cde-8478-410ccb3f75aa service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Updating instance_info_cache with network_info: [{"id": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "address": "fa:16:3e:24:bd:89", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e42c23-4f", "ovs_interfaceid": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:38:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-95fb0871-066f-4bbc-94c2-4505253649d9 req-6e33d955-b6c2-4cde-8478-410ccb3f75aa service nova] Releasing lock "refresh_cache-1f86ee09-062b-428d-9870-14de77c569c0" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:38:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:04 user nova-compute[75018]: DEBUG nova.compute.manager [req-85c108a4-afcd-4089-9865-719c7eef53c8 req-3985bf48-7c05-4336-9a0c-5136a21166fb service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Received event network-vif-plugged-58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-85c108a4-afcd-4089-9865-719c7eef53c8 req-3985bf48-7c05-4336-9a0c-5136a21166fb service nova] Acquiring lock "1f86ee09-062b-428d-9870-14de77c569c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-85c108a4-afcd-4089-9865-719c7eef53c8 req-3985bf48-7c05-4336-9a0c-5136a21166fb service nova] Lock "1f86ee09-062b-428d-9870-14de77c569c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-85c108a4-afcd-4089-9865-719c7eef53c8 req-3985bf48-7c05-4336-9a0c-5136a21166fb service nova] Lock "1f86ee09-062b-428d-9870-14de77c569c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:04 user nova-compute[75018]: DEBUG nova.compute.manager [req-85c108a4-afcd-4089-9865-719c7eef53c8 req-3985bf48-7c05-4336-9a0c-5136a21166fb service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] No waiting events found dispatching network-vif-plugged-58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:38:04 user nova-compute[75018]: WARNING nova.compute.manager [req-85c108a4-afcd-4089-9865-719c7eef53c8 req-3985bf48-7c05-4336-9a0c-5136a21166fb service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Received unexpected event network-vif-plugged-58e42c23-4f3b-4394-aa4f-42ae19671af0 for instance with vm_state building and task_state spawning.
Nov 07 15:38:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:38:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:38:06 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Instance spawned successfully.
Nov 07 15:38:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:38:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:38:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:38:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:38:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:38:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:38:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:38:06 user nova-compute[75018]: INFO nova.compute.manager [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 07 15:38:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:38:06 user nova-compute[75018]: DEBUG nova.compute.manager [req-ed4caca5-e91e-462f-bb3b-422ab7e84917 req-33cee6f6-0a3c-4e56-9259-262475e1fbfc service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Received event network-vif-plugged-58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ed4caca5-e91e-462f-bb3b-422ab7e84917 req-33cee6f6-0a3c-4e56-9259-262475e1fbfc service nova] Acquiring lock "1f86ee09-062b-428d-9870-14de77c569c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ed4caca5-e91e-462f-bb3b-422ab7e84917 req-33cee6f6-0a3c-4e56-9259-262475e1fbfc service nova] Lock "1f86ee09-062b-428d-9870-14de77c569c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ed4caca5-e91e-462f-bb3b-422ab7e84917 req-33cee6f6-0a3c-4e56-9259-262475e1fbfc service nova] Lock "1f86ee09-062b-428d-9870-14de77c569c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:06 user nova-compute[75018]: DEBUG nova.compute.manager [req-ed4caca5-e91e-462f-bb3b-422ab7e84917 req-33cee6f6-0a3c-4e56-9259-262475e1fbfc service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] No waiting events found dispatching network-vif-plugged-58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:38:06 user nova-compute[75018]: WARNING nova.compute.manager [req-ed4caca5-e91e-462f-bb3b-422ab7e84917 req-33cee6f6-0a3c-4e56-9259-262475e1fbfc service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Received unexpected event network-vif-plugged-58e42c23-4f3b-4394-aa4f-42ae19671af0 for instance with vm_state building and task_state spawning.
Nov 07 15:38:06 user nova-compute[75018]: INFO nova.compute.manager [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Took 6.32 seconds to build instance.
Nov 07 15:38:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9a5c64a0-3283-4406-93a0-00ee248afbee tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "1f86ee09-062b-428d-9870-14de77c569c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.419s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:38:18 user nova-compute[75018]: INFO nova.compute.claims [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Claim successful on node user
Nov 07 15:38:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:38:18 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:38:18 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG nova.policy [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8af061ec9b2444ecbbc2d1ef913fe558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393342d93e71462eba531f173860d59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:38:18 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Creating image(s)
Nov 07 15:38:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "/opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "/opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "/opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk 1073741824" returned: 0 in 0.047s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Successfully created port: 16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.186s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Cannot resize image /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Ensure instance console log exists: /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Successfully updated port: 16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "refresh_cache-79aba108-cfd6-4e83-99f5-50403a500a87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquired lock "refresh_cache-79aba108-cfd6-4e83-99f5-50403a500a87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-7a2277c5-0444-4a0b-9c1a-87ed3864c6a6 req-df6b6193-4464-490f-ac82-05cb3d0ae147 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received event network-changed-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-7a2277c5-0444-4a0b-9c1a-87ed3864c6a6 req-df6b6193-4464-490f-ac82-05cb3d0ae147 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Refreshing instance network info cache due to event network-changed-16ad0001-44b6-47a4-a689-4a7cae768eb3. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7a2277c5-0444-4a0b-9c1a-87ed3864c6a6 req-df6b6193-4464-490f-ac82-05cb3d0ae147 service nova] Acquiring lock "refresh_cache-79aba108-cfd6-4e83-99f5-50403a500a87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Updating instance_info_cache with network_info: [{"id": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "address": "fa:16:3e:77:f2:a5", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ad0001-44", "ovs_interfaceid": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Releasing lock "refresh_cache-79aba108-cfd6-4e83-99f5-50403a500a87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Instance network_info: |[{"id": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "address": "fa:16:3e:77:f2:a5", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ad0001-44", "ovs_interfaceid": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7a2277c5-0444-4a0b-9c1a-87ed3864c6a6 req-df6b6193-4464-490f-ac82-05cb3d0ae147 service nova] Acquired lock "refresh_cache-79aba108-cfd6-4e83-99f5-50403a500a87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.network.neutron [req-7a2277c5-0444-4a0b-9c1a-87ed3864c6a6 req-df6b6193-4464-490f-ac82-05cb3d0ae147 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Refreshing network info cache for port 16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Start _get_guest_xml network_info=[{"id": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "address": "fa:16:3e:77:f2:a5", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ad0001-44", "ovs_interfaceid": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:38:20 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:38:20 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1211350405',display_name='tempest-AttachVolumeTestJSON-server-1211350405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1211350405',id=33,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPQirCTSZkbnlG9q3vbm2c23iyeL4LTdNUFXqO3d1OARPNvRYAlG+nw4COIS3h42nzgeiQ1uBOT46/fJKjg5IC7rX07FGtM/eovzNT9CThtbgLPeBXrWMbokD6UMiKqmg==',key_name='tempest-keypair-217927639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='393342d93e71462eba531f173860d59f',ramdisk_id='',reservation_id='r-si59g7p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1503001538',owner_user_name='tempest-AttachVolumeTestJSON-1503001538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8af061ec9b2444ecbbc2d1ef913fe558',uuid=79aba108-cfd6-4e83-99f5-50403a500a87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "address": "fa:16:3e:77:f2:a5", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ad0001-44", "ovs_interfaceid": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converting VIF {"id": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "address": "fa:16:3e:77:f2:a5", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ad0001-44", "ovs_interfaceid": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=16ad0001-44b6-47a4-a689-4a7cae768eb3,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ad0001-44') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.objects.instance [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'pci_devices' on Instance uuid 79aba108-cfd6-4e83-99f5-50403a500a87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:38:20 user nova-compute[75018]:   <uuid>79aba108-cfd6-4e83-99f5-50403a500a87</uuid>
Nov 07 15:38:20 user nova-compute[75018]:   <name>instance-00000021</name>
Nov 07 15:38:20 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:38:20 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:38:20 user nova-compute[75018]:   <metadata>
Nov 07 15:38:20 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:38:20 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:38:20 user nova-compute[75018]:       <nova:name>tempest-AttachVolumeTestJSON-server-1211350405</nova:name>
Nov 07 15:38:20 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:38:20</nova:creationTime>
Nov 07 15:38:20 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:38:20 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:38:20 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:38:20 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:38:20 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:38:20 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:38:20 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:38:20 user nova-compute[75018]:       <nova:owner>
Nov 07 15:38:20 user nova-compute[75018]:         <nova:user uuid="8af061ec9b2444ecbbc2d1ef913fe558">tempest-AttachVolumeTestJSON-1503001538-project-member</nova:user>
Nov 07 15:38:20 user nova-compute[75018]:         <nova:project uuid="393342d93e71462eba531f173860d59f">tempest-AttachVolumeTestJSON-1503001538</nova:project>
Nov 07 15:38:20 user nova-compute[75018]:       </nova:owner>
Nov 07 15:38:20 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:38:20 user nova-compute[75018]:       <nova:ports>
Nov 07 15:38:20 user nova-compute[75018]:         <nova:port uuid="16ad0001-44b6-47a4-a689-4a7cae768eb3">
Nov 07 15:38:20 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 15:38:20 user nova-compute[75018]:         </nova:port>
Nov 07 15:38:20 user nova-compute[75018]:       </nova:ports>
Nov 07 15:38:20 user nova-compute[75018]:     </nova:instance>
Nov 07 15:38:20 user nova-compute[75018]:   </metadata>
Nov 07 15:38:20 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:38:20 user nova-compute[75018]:     <system>
Nov 07 15:38:20 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:38:20 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:38:20 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:38:20 user nova-compute[75018]:       <entry name="serial">79aba108-cfd6-4e83-99f5-50403a500a87</entry>
Nov 07 15:38:20 user nova-compute[75018]:       <entry name="uuid">79aba108-cfd6-4e83-99f5-50403a500a87</entry>
Nov 07 15:38:20 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:38:20 user nova-compute[75018]:     </system>
Nov 07 15:38:20 user nova-compute[75018]:   </sysinfo>
Nov 07 15:38:20 user nova-compute[75018]:   <os>
Nov 07 15:38:20 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:38:20 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:38:20 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:38:20 user nova-compute[75018]:   </os>
Nov 07 15:38:20 user nova-compute[75018]:   <features>
Nov 07 15:38:20 user nova-compute[75018]:     <acpi/>
Nov 07 15:38:20 user nova-compute[75018]:     <apic/>
Nov 07 15:38:20 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:38:20 user nova-compute[75018]:   </features>
Nov 07 15:38:20 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:38:20 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:38:20 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:38:20 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:38:20 user nova-compute[75018]:   </clock>
Nov 07 15:38:20 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:38:20 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:38:20 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:38:20 user nova-compute[75018]:   </cpu>
Nov 07 15:38:20 user nova-compute[75018]:   <devices>
Nov 07 15:38:20 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:38:20 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:38:20 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk"/>
Nov 07 15:38:20 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:38:20 user nova-compute[75018]:     </disk>
Nov 07 15:38:20 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:38:20 user nova-compute[75018]:       <mac address="fa:16:3e:77:f2:a5"/>
Nov 07 15:38:20 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:38:20 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:38:20 user nova-compute[75018]:       <target dev="tap16ad0001-44"/>
Nov 07 15:38:20 user nova-compute[75018]:     </interface>
Nov 07 15:38:20 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:38:20 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/console.log" append="off"/>
Nov 07 15:38:20 user nova-compute[75018]:     </serial>
Nov 07 15:38:20 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:38:20 user nova-compute[75018]:     <video>
Nov 07 15:38:20 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:38:20 user nova-compute[75018]:     </video>
Nov 07 15:38:20 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:38:20 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:38:20 user nova-compute[75018]:     </rng>
Nov 07 15:38:20 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:38:20 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:38:20 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:38:20 user nova-compute[75018]:     </memballoon>
Nov 07 15:38:20 user nova-compute[75018]:   </devices>
Nov 07 15:38:20 user nova-compute[75018]: </domain>
Nov 07 15:38:20 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1211350405',display_name='tempest-AttachVolumeTestJSON-server-1211350405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1211350405',id=33,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPQirCTSZkbnlG9q3vbm2c23iyeL4LTdNUFXqO3d1OARPNvRYAlG+nw4COIS3h42nzgeiQ1uBOT46/fJKjg5IC7rX07FGtM/eovzNT9CThtbgLPeBXrWMbokD6UMiKqmg==',key_name='tempest-keypair-217927639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='393342d93e71462eba531f173860d59f',ramdisk_id='',reservation_id='r-si59g7p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1503001538',owner_user_name='tempest-AttachVolumeTestJSON-1503001538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8af061ec9b2444ecbbc2d1ef913fe558',uuid=79aba108-cfd6-4e83-99f5-50403a500a87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "address": "fa:16:3e:77:f2:a5", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ad0001-44", "ovs_interfaceid": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converting VIF {"id": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "address": "fa:16:3e:77:f2:a5", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ad0001-44", "ovs_interfaceid": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=16ad0001-44b6-47a4-a689-4a7cae768eb3,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ad0001-44') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG os_vif [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=16ad0001-44b6-47a4-a689-4a7cae768eb3,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ad0001-44') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0de27298-8ae7-5c42-84b7-9baa8f6c47b5', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16ad0001-44, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16ad0001-44, col_values=(('qos', UUID('7cb1f063-1ee6-4bb2-b1b8-ee5caa2f082c')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16ad0001-44, col_values=(('external_ids', {'iface-id': '16ad0001-44b6-47a4-a689-4a7cae768eb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:f2:a5', 'vm-uuid': '79aba108-cfd6-4e83-99f5-50403a500a87'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:20 user nova-compute[75018]: INFO os_vif [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=16ad0001-44b6-47a4-a689-4a7cae768eb3,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ad0001-44')
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] No VIF found with MAC fa:16:3e:77:f2:a5, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.network.neutron [req-7a2277c5-0444-4a0b-9c1a-87ed3864c6a6 req-df6b6193-4464-490f-ac82-05cb3d0ae147 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Updated VIF entry in instance network info cache for port 16ad0001-44b6-47a4-a689-4a7cae768eb3. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG nova.network.neutron [req-7a2277c5-0444-4a0b-9c1a-87ed3864c6a6 req-df6b6193-4464-490f-ac82-05cb3d0ae147 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Updating instance_info_cache with network_info: [{"id": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "address": "fa:16:3e:77:f2:a5", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ad0001-44", "ovs_interfaceid": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7a2277c5-0444-4a0b-9c1a-87ed3864c6a6 req-df6b6193-4464-490f-ac82-05cb3d0ae147 service nova] Releasing lock "refresh_cache-79aba108-cfd6-4e83-99f5-50403a500a87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:38:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-83244e7e-dab6-49e0-bfc8-7020a2123542 req-6954f20b-d790-4f2c-8d8d-07baf44b1882 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received event network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-83244e7e-dab6-49e0-bfc8-7020a2123542 req-6954f20b-d790-4f2c-8d8d-07baf44b1882 service nova] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-83244e7e-dab6-49e0-bfc8-7020a2123542 req-6954f20b-d790-4f2c-8d8d-07baf44b1882 service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-83244e7e-dab6-49e0-bfc8-7020a2123542 req-6954f20b-d790-4f2c-8d8d-07baf44b1882 service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-83244e7e-dab6-49e0-bfc8-7020a2123542 req-6954f20b-d790-4f2c-8d8d-07baf44b1882 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] No waiting events found dispatching network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:38:22 user nova-compute[75018]: WARNING nova.compute.manager [req-83244e7e-dab6-49e0-bfc8-7020a2123542 req-6954f20b-d790-4f2c-8d8d-07baf44b1882 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received unexpected event network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 for instance with vm_state building and task_state spawning.
Nov 07 15:38:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-2f041ec0-7da6-446e-b410-1fd57bd06bd6 req-ded0f201-ae2c-414f-849a-513fafcb5db8 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received event network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2f041ec0-7da6-446e-b410-1fd57bd06bd6 req-ded0f201-ae2c-414f-849a-513fafcb5db8 service nova] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2f041ec0-7da6-446e-b410-1fd57bd06bd6 req-ded0f201-ae2c-414f-849a-513fafcb5db8 service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2f041ec0-7da6-446e-b410-1fd57bd06bd6 req-ded0f201-ae2c-414f-849a-513fafcb5db8 service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-2f041ec0-7da6-446e-b410-1fd57bd06bd6 req-ded0f201-ae2c-414f-849a-513fafcb5db8 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] No waiting events found dispatching network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:38:24 user nova-compute[75018]: WARNING nova.compute.manager [req-2f041ec0-7da6-446e-b410-1fd57bd06bd6 req-ded0f201-ae2c-414f-849a-513fafcb5db8 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received unexpected event network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 for instance with vm_state building and task_state spawning.
Nov 07 15:38:24 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:38:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:38:24 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Instance spawned successfully.
Nov 07 15:38:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:38:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:38:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:38:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:38:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:38:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:38:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:38:25 user nova-compute[75018]: INFO nova.compute.manager [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Took 6.19 seconds to spawn the instance on the hypervisor.
Nov 07 15:38:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:38:25 user nova-compute[75018]: INFO nova.compute.manager [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Took 6.97 seconds to build instance.
Nov 07 15:38:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1301c4ed-ac27-4e6a-995d-b4f814471733 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.123s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG nova.compute.manager [req-066c6e6c-5999-4511-b9c2-1b3a0f9c15e8 req-b56b2257-3e8c-46f8-ba54-faff434c8f4e service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-changed-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG nova.compute.manager [req-066c6e6c-5999-4511-b9c2-1b3a0f9c15e8 req-b56b2257-3e8c-46f8-ba54-faff434c8f4e service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Refreshing instance network info cache due to event network-changed-280fe9e4-a375-4c55-adf5-babbe012ef3b. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-066c6e6c-5999-4511-b9c2-1b3a0f9c15e8 req-b56b2257-3e8c-46f8-ba54-faff434c8f4e service nova] Acquiring lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-066c6e6c-5999-4511-b9c2-1b3a0f9c15e8 req-b56b2257-3e8c-46f8-ba54-faff434c8f4e service nova] Acquired lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG nova.network.neutron [req-066c6e6c-5999-4511-b9c2-1b3a0f9c15e8 req-b56b2257-3e8c-46f8-ba54-faff434c8f4e service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Refreshing network info cache for port 280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG nova.objects.instance [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'flavor' on Instance uuid e4ad018d-bdc7-458b-9e77-ba31457e52ff {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.145s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:26 user nova-compute[75018]: INFO nova.compute.manager [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Attaching volume 28e9704f-2b83-4dbf-9311-216e4d9b1444 to /dev/vdb
Nov 07 15:38:26 user nova-compute[75018]: DEBUG os_brick.utils [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73d9f9b-6231-4103-8ad3-73f9e081b070]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fbc6ca-3a68-46f2-83de-a4e042a55d25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG nova.network.neutron [req-066c6e6c-5999-4511-b9c2-1b3a0f9c15e8 req-b56b2257-3e8c-46f8-ba54-faff434c8f4e service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updated VIF entry in instance network info cache for port 280fe9e4-a375-4c55-adf5-babbe012ef3b. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG nova.network.neutron [req-066c6e6c-5999-4511-b9c2-1b3a0f9c15e8 req-b56b2257-3e8c-46f8-ba54-faff434c8f4e service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updating instance_info_cache with network_info: [{"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.037s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[374babf1-ccc2-4693-9235-6a23cef76629]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95c2846-1d6b-4e64-8fef-cbd0c33a37b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-066c6e6c-5999-4511-b9c2-1b3a0f9c15e8 req-b56b2257-3e8c-46f8-ba54-faff434c8f4e service nova] Releasing lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:38:26 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:38:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b443887e-3135-4dae-8cc3-cc5f8e19c039]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG os_brick.utils [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:38:26 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updating existing volume attachment record: 0ee99fb2-5a9a-43fd-9b5b-7f089219894d {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:38:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Acquiring lock "374fbc2b-2e56-454e-a661-89c94af582ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "374fbc2b-2e56-454e-a661-89c94af582ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Acquiring lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:27 user nova-compute[75018]: INFO nova.compute.manager [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Terminating instance
Nov 07 15:38:27 user nova-compute[75018]: DEBUG nova.compute.manager [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:38:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-8fd6527c-34f4-4301-98e6-347c1bf10100 req-62b80a34-1084-45de-b1b5-582eb33ff5bd service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Received event network-vif-unplugged-27e0ec73-3d90-434e-a755-47b5778359c0 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8fd6527c-34f4-4301-98e6-347c1bf10100 req-62b80a34-1084-45de-b1b5-582eb33ff5bd service nova] Acquiring lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8fd6527c-34f4-4301-98e6-347c1bf10100 req-62b80a34-1084-45de-b1b5-582eb33ff5bd service nova] Lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8fd6527c-34f4-4301-98e6-347c1bf10100 req-62b80a34-1084-45de-b1b5-582eb33ff5bd service nova] Lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-8fd6527c-34f4-4301-98e6-347c1bf10100 req-62b80a34-1084-45de-b1b5-582eb33ff5bd service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] No waiting events found dispatching network-vif-unplugged-27e0ec73-3d90-434e-a755-47b5778359c0 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-8fd6527c-34f4-4301-98e6-347c1bf10100 req-62b80a34-1084-45de-b1b5-582eb33ff5bd service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Received event network-vif-unplugged-27e0ec73-3d90-434e-a755-47b5778359c0 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:38:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Instance destroyed successfully.
Nov 07 15:38:28 user nova-compute[75018]: DEBUG nova.objects.instance [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lazy-loading 'resources' on Instance uuid 374fbc2b-2e56-454e-a661-89c94af582ac {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-517816215',display_name='tempest-VolumesNegativeTest-instance-517816215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-517816215',id=29,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d86071a5b854c9ba57c2ed62cf04de2',ramdisk_id='',reservation_id='r-nyivyvpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1528193776',owner_user_name='tempest-VolumesNegativeTest-1528193776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:36:47Z,user_data=None,user_id='8bae1f496c344ad28c0393b076aa4fdb',uuid=374fbc2b-2e56-454e-a661-89c94af582ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27e0ec73-3d90-434e-a755-47b5778359c0", "address": "fa:16:3e:67:82:c9", "network": {"id": "ad00e229-3149-4aae-ac71-dad21e6a09d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9ad2a7b49899449c8127f8306add3c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e0ec73-3d", "ovs_interfaceid": "27e0ec73-3d90-434e-a755-47b5778359c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Converting VIF {"id": "27e0ec73-3d90-434e-a755-47b5778359c0", "address": "fa:16:3e:67:82:c9", "network": {"id": "ad00e229-3149-4aae-ac71-dad21e6a09d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9ad2a7b49899449c8127f8306add3c2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e0ec73-3d", "ovs_interfaceid": "27e0ec73-3d90-434e-a755-47b5778359c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:82:c9,bridge_name='br-int',has_traffic_filtering=True,id=27e0ec73-3d90-434e-a755-47b5778359c0,network=Network(ad00e229-3149-4aae-ac71-dad21e6a09d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e0ec73-3d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG os_vif [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:82:c9,bridge_name='br-int',has_traffic_filtering=True,id=27e0ec73-3d90-434e-a755-47b5778359c0,network=Network(ad00e229-3149-4aae-ac71-dad21e6a09d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e0ec73-3d') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27e0ec73-3d, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c6c86a0-68c9-4cf8-8b57-317cfd2d98ff) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:28 user nova-compute[75018]: INFO os_vif [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:82:c9,bridge_name='br-int',has_traffic_filtering=True,id=27e0ec73-3d90-434e-a755-47b5778359c0,network=Network(ad00e229-3149-4aae-ac71-dad21e6a09d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e0ec73-3d')
Nov 07 15:38:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Deleting instance files /opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac_del
Nov 07 15:38:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Deletion of /opt/stack/data/nova/instances/374fbc2b-2e56-454e-a661-89c94af582ac_del complete
Nov 07 15:38:29 user nova-compute[75018]: INFO nova.compute.manager [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 07 15:38:29 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:38:29 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:38:29 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:38:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:38:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:38:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-f15af46f-7179-4b45-806f-570c303cc4bd req-75c70bec-a150-4a49-8625-4689be8cf25b service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Received event network-vif-deleted-27e0ec73-3d90-434e-a755-47b5778359c0 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:30 user nova-compute[75018]: INFO nova.compute.manager [req-f15af46f-7179-4b45-806f-570c303cc4bd req-75c70bec-a150-4a49-8625-4689be8cf25b service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Neutron deleted interface 27e0ec73-3d90-434e-a755-47b5778359c0; detaching it from the instance and deleting it from the info cache
Nov 07 15:38:30 user nova-compute[75018]: DEBUG nova.network.neutron [req-f15af46f-7179-4b45-806f-570c303cc4bd req-75c70bec-a150-4a49-8625-4689be8cf25b service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:38:30 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:38:30 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Took 1.17 seconds to deallocate network for instance.
Nov 07 15:38:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-f15af46f-7179-4b45-806f-570c303cc4bd req-75c70bec-a150-4a49-8625-4689be8cf25b service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Detach interface failed, port_id=27e0ec73-3d90-434e-a755-47b5778359c0, reason: Instance 374fbc2b-2e56-454e-a661-89c94af582ac could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:38:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-b30b5037-a918-427a-b458-f8ac9507f413 req-469c5e92-e2b8-4e4c-8c3e-9c46dbf4fd4d service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Received event network-vif-plugged-27e0ec73-3d90-434e-a755-47b5778359c0 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b30b5037-a918-427a-b458-f8ac9507f413 req-469c5e92-e2b8-4e4c-8c3e-9c46dbf4fd4d service nova] Acquiring lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b30b5037-a918-427a-b458-f8ac9507f413 req-469c5e92-e2b8-4e4c-8c3e-9c46dbf4fd4d service nova] Lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b30b5037-a918-427a-b458-f8ac9507f413 req-469c5e92-e2b8-4e4c-8c3e-9c46dbf4fd4d service nova] Lock "374fbc2b-2e56-454e-a661-89c94af582ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-b30b5037-a918-427a-b458-f8ac9507f413 req-469c5e92-e2b8-4e4c-8c3e-9c46dbf4fd4d service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] No waiting events found dispatching network-vif-plugged-27e0ec73-3d90-434e-a755-47b5778359c0 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:38:30 user nova-compute[75018]: WARNING nova.compute.manager [req-b30b5037-a918-427a-b458-f8ac9507f413 req-469c5e92-e2b8-4e4c-8c3e-9c46dbf4fd4d service nova] [instance: 374fbc2b-2e56-454e-a661-89c94af582ac] Received unexpected event network-vif-plugged-27e0ec73-3d90-434e-a755-47b5778359c0 for instance with vm_state active and task_state deleting.
Nov 07 15:38:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:38:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:38:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:31 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:38:31 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:38:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.745s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:38:31 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Deleted allocations for instance 374fbc2b-2e56-454e-a661-89c94af582ac
Nov 07 15:38:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-00222b3e-55d4-4995-b9bb-92981e7a8f9a tempest-VolumesNegativeTest-1528193776 tempest-VolumesNegativeTest-1528193776-project-member] Lock "374fbc2b-2e56-454e-a661-89c94af582ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.053s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-62738cf2-913b-4dcd-849d-13177cb45db9 req-fd6a9ecc-2dad-4549-80e1-eb8349b8ef14 service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Received event network-changed-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-62738cf2-913b-4dcd-849d-13177cb45db9 req-fd6a9ecc-2dad-4549-80e1-eb8349b8ef14 service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Refreshing instance network info cache due to event network-changed-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-62738cf2-913b-4dcd-849d-13177cb45db9 req-fd6a9ecc-2dad-4549-80e1-eb8349b8ef14 service nova] Acquiring lock "refresh_cache-98c33773-942b-422b-b4fd-a2b548260c09" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-62738cf2-913b-4dcd-849d-13177cb45db9 req-fd6a9ecc-2dad-4549-80e1-eb8349b8ef14 service nova] Acquired lock "refresh_cache-98c33773-942b-422b-b4fd-a2b548260c09" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-62738cf2-913b-4dcd-849d-13177cb45db9 req-fd6a9ecc-2dad-4549-80e1-eb8349b8ef14 service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Refreshing network info cache for port 8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-62738cf2-913b-4dcd-849d-13177cb45db9 req-fd6a9ecc-2dad-4549-80e1-eb8349b8ef14 service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Updated VIF entry in instance network info cache for port 8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-62738cf2-913b-4dcd-849d-13177cb45db9 req-fd6a9ecc-2dad-4549-80e1-eb8349b8ef14 service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Updating instance_info_cache with network_info: [{"id": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "address": "fa:16:3e:6f:c7:ae", "network": {"id": "3bc44c82-a575-4e5c-8661-2411b93b96bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1450868802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e330da770824aad9f8e6c1e312c2e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c33f4e9-4c", "ovs_interfaceid": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "98c33773-942b-422b-b4fd-a2b548260c09" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-62738cf2-913b-4dcd-849d-13177cb45db9 req-fd6a9ecc-2dad-4549-80e1-eb8349b8ef14 service nova] Releasing lock "refresh_cache-98c33773-942b-422b-b4fd-a2b548260c09" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG nova.objects.instance [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lazy-loading 'flavor' on Instance uuid 98c33773-942b-422b-b4fd-a2b548260c09 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "98c33773-942b-422b-b4fd-a2b548260c09" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:32 user nova-compute[75018]: INFO nova.compute.manager [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Attaching volume 9cfc9935-3bd0-4df5-a4da-9ca480821b6f to /dev/vdb
Nov 07 15:38:32 user nova-compute[75018]: DEBUG os_brick.utils [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e6491c-3baa-481d-a5dc-510a5de6c722]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9bc337-4f48-4956-8efa-73a32eee681d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da8ae18-6e3d-4a40-be50-4c27d903a1c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[642f9b9f-d836-46c1-93fe-587229472d55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:38:33 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:38:33 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf7afc7-9375-480b-a79b-013fd342493a]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG os_brick.utils [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Updating existing volume attachment record: 97ba9203-16ed-46d0-874d-b1da4a3ba3ed {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:38:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:36 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:38:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:38:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:38:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:38:36 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:38:37 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Updating instance_info_cache with network_info: [{"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:38:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:38:37 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:38:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:38:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:37 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:38:37 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:38:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG nova.compute.manager [req-07480c36-4a32-40a5-a7b1-237270d0ffc3 req-faaaeca8-424b-45d5-986c-c9feaad50c75 service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Received event network-changed-fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG nova.compute.manager [req-07480c36-4a32-40a5-a7b1-237270d0ffc3 req-faaaeca8-424b-45d5-986c-c9feaad50c75 service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Refreshing instance network info cache due to event network-changed-fb52e207-387c-43d0-9382-dcde18f34a8e. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-07480c36-4a32-40a5-a7b1-237270d0ffc3 req-faaaeca8-424b-45d5-986c-c9feaad50c75 service nova] Acquiring lock "refresh_cache-4bf14e55-beb3-4800-8472-3436fa21b45e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-07480c36-4a32-40a5-a7b1-237270d0ffc3 req-faaaeca8-424b-45d5-986c-c9feaad50c75 service nova] Acquired lock "refresh_cache-4bf14e55-beb3-4800-8472-3436fa21b45e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG nova.network.neutron [req-07480c36-4a32-40a5-a7b1-237270d0ffc3 req-faaaeca8-424b-45d5-986c-c9feaad50c75 service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Refreshing network info cache for port fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:41 user nova-compute[75018]: DEBUG nova.network.neutron [req-07480c36-4a32-40a5-a7b1-237270d0ffc3 req-faaaeca8-424b-45d5-986c-c9feaad50c75 service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Updated VIF entry in instance network info cache for port fb52e207-387c-43d0-9382-dcde18f34a8e. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:38:41 user nova-compute[75018]: DEBUG nova.network.neutron [req-07480c36-4a32-40a5-a7b1-237270d0ffc3 req-faaaeca8-424b-45d5-986c-c9feaad50c75 service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Updating instance_info_cache with network_info: [{"id": "fb52e207-387c-43d0-9382-dcde18f34a8e", "address": "fa:16:3e:87:db:1b", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e207-38", "ovs_interfaceid": "fb52e207-387c-43d0-9382-dcde18f34a8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:38:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-07480c36-4a32-40a5-a7b1-237270d0ffc3 req-faaaeca8-424b-45d5-986c-c9feaad50c75 service nova] Releasing lock "refresh_cache-4bf14e55-beb3-4800-8472-3436fa21b45e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:38:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:42 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:38:42 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7682MB free_disk=24.133888244628906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 31e90a00-c2df-493c-9b7e-12d3063b877f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e4ad018d-bdc7-458b-9e77-ba31457e52ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 98c33773-942b-422b-b4fd-a2b548260c09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 4bf14e55-beb3-4800-8472-3436fa21b45e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1f86ee09-062b-428d-9870-14de77c569c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 79aba108-cfd6-4e83-99f5-50403a500a87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:38:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:38:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:38:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:38:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUTWPgsF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:38:51 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:38:51 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:38:51 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4690b7b-9140-46b5-baac-b669234276c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:38:51 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6745daa9-9915-4f38-b495-9f3511dc2666]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444] added
Nov 07 15:38:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1ff6a4-a6d8-42fe-96bd-c71a11369d73]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a818c6-d511-45e2-868f-45cb279d0746]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AUTWPgsF {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AUTWPgsF" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f307431-66e1-4664-b3d2-bf0adfd68f32]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AUTWPgsF'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[55792d16-5f14-4df8-b6e0-1db97fd068f0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b088ef12-b9db-476f-ad85-62cfd416202e]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:38:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:38:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[162d14a2-a5ff-4d5e-8792-33ede4a32793]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444, portal: 172.16.0.220,3260]
Nov 07 15:38:51 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444, portal: 172.16.0.220,3260] successful.
Nov 07 15:38:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35bce4e-0611-4669-95a2-7befdfa6fad7]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[db47ee0f-3a59-4cc9-8974-c122201380d3]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:38:51 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:38:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:38:51 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:38:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26a1fce-b1c4-4aee-aa32-c01f4407df25]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:38:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUTWPgsF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:38:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:38:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23937363234386538', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:38:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937363234386538', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:38:52 user nova-compute[75018]: DEBUG nova.objects.instance [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'flavor' on Instance uuid e4ad018d-bdc7-458b-9e77-ba31457e52ff {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:38:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:38:52 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:38:52 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:38:52 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:38:52 user nova-compute[75018]:   <serial>28e9704f-2b83-4dbf-9311-216e4d9b1444</serial>
Nov 07 15:38:52 user nova-compute[75018]: </disk>
Nov 07 15:38:52 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:38:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:38:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:38:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No VIF found with MAC fa:16:3e:a7:84:70, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:38:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-45810d33-64bb-41ab-b1b8-360bb9c8d46a tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.899s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:54 user nova-compute[75018]: INFO nova.compute.manager [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Rescuing
Nov 07 15:38:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:38:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquired lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:38:54 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updating instance_info_cache with network_info: [{"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Releasing lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-78a25243-a5d9-4f91-9e9d-679955ba50e2 req-bdb3b8fb-a12f-4dad-a82a-12e646c413e8 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-vif-unplugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-78a25243-a5d9-4f91-9e9d-679955ba50e2 req-bdb3b8fb-a12f-4dad-a82a-12e646c413e8 service nova] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-78a25243-a5d9-4f91-9e9d-679955ba50e2 req-bdb3b8fb-a12f-4dad-a82a-12e646c413e8 service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-78a25243-a5d9-4f91-9e9d-679955ba50e2 req-bdb3b8fb-a12f-4dad-a82a-12e646c413e8 service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-78a25243-a5d9-4f91-9e9d-679955ba50e2 req-bdb3b8fb-a12f-4dad-a82a-12e646c413e8 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] No waiting events found dispatching network-vif-unplugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:38:55 user nova-compute[75018]: WARNING nova.compute.manager [req-78a25243-a5d9-4f91-9e9d-679955ba50e2 req-bdb3b8fb-a12f-4dad-a82a-12e646c413e8 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received unexpected event network-vif-unplugged-280fe9e4-a375-4c55-adf5-babbe012ef3b for instance with vm_state active and task_state rescuing.
Nov 07 15:38:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:55 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Instance destroyed successfully.
Nov 07 15:38:55 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Attempting rescue
Nov 07 15:38:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75018) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Instance directory exists: not creating {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 15:38:55 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Creating image(s)
Nov 07 15:38:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "/opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "/opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'trusted_certs' on Instance uuid e4ad018d-bdc7-458b-9e77-ba31457e52ff {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.rescue {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.rescue" returned: 0 in 0.109s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'migration_context' on Instance uuid e4ad018d-bdc7-458b-9e77-ba31457e52ff {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.objects.base [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<e4ad018d-bdc7-458b-9e77-ba31457e52ff> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Start _get_guest_xml network_info=[{"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "vif_mac": "fa:16:3e:a7:84:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '667dc137-8627-496e-9a1f-9f5738befeda', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'resources' on Instance uuid e4ad018d-bdc7-458b-9e77-ba31457e52ff {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.objects.base [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<e4ad018d-bdc7-458b-9e77-ba31457e52ff> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'numa_topology' on Instance uuid e4ad018d-bdc7-458b-9e77-ba31457e52ff {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.objects.base [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<e4ad018d-bdc7-458b-9e77-ba31457e52ff> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:38:56 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:38:56 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4ad018d-bdc7-458b-9e77-ba31457e52ff {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.objects.base [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<e4ad018d-bdc7-458b-9e77-ba31457e52ff> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:36:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-383028183',display_name='tempest-ServerRescueNegativeTestJSON-server-383028183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-383028183',id=28,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXlVLFR1auiipSprdX96rkwHLVObqrWok4UB8xbGBLwxbV3XoGdfCwIP9llsZoGGWjO60XbhFNifEi5pPhV3RvNdDG0ZBk1XRXIWWyz6JGQQrqGIsByOItviiS/2raJrA==',key_name='tempest-keypair-1034588000',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374a202b7d114f009ac374762e08c364',ramdisk_id='',reservation_id='r-x55em1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1476352427',owner_user_name='tempest-ServerRescueNegativeTestJSON-1476352427-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:36:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='869a94fcb52246d583be8bac4a722a3c',uuid=e4ad018d-bdc7-458b-9e77-ba31457e52ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "vif_mac": "fa:16:3e:a7:84:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converting VIF {"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "vif_mac": "fa:16:3e:a7:84:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:84:70,bridge_name='br-int',has_traffic_filtering=True,id=280fe9e4-a375-4c55-adf5-babbe012ef3b,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280fe9e4-a3') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'pci_devices' on Instance uuid e4ad018d-bdc7-458b-9e77-ba31457e52ff {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.objects.base [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Object Instance<e4ad018d-bdc7-458b-9e77-ba31457e52ff> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:38:56 user nova-compute[75018]:   <uuid>e4ad018d-bdc7-458b-9e77-ba31457e52ff</uuid>
Nov 07 15:38:56 user nova-compute[75018]:   <name>instance-0000001c</name>
Nov 07 15:38:56 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:38:56 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:38:56 user nova-compute[75018]:   <metadata>
Nov 07 15:38:56 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:38:56 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:38:56 user nova-compute[75018]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-383028183</nova:name>
Nov 07 15:38:56 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:38:56</nova:creationTime>
Nov 07 15:38:56 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:38:56 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:38:56 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:38:56 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:38:56 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:38:56 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:38:56 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:38:56 user nova-compute[75018]:       <nova:owner>
Nov 07 15:38:56 user nova-compute[75018]:         <nova:user uuid="869a94fcb52246d583be8bac4a722a3c">tempest-ServerRescueNegativeTestJSON-1476352427-project-member</nova:user>
Nov 07 15:38:56 user nova-compute[75018]:         <nova:project uuid="374a202b7d114f009ac374762e08c364">tempest-ServerRescueNegativeTestJSON-1476352427</nova:project>
Nov 07 15:38:56 user nova-compute[75018]:       </nova:owner>
Nov 07 15:38:56 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:38:56 user nova-compute[75018]:       <nova:ports>
Nov 07 15:38:56 user nova-compute[75018]:         <nova:port uuid="280fe9e4-a375-4c55-adf5-babbe012ef3b">
Nov 07 15:38:56 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 07 15:38:56 user nova-compute[75018]:         </nova:port>
Nov 07 15:38:56 user nova-compute[75018]:       </nova:ports>
Nov 07 15:38:56 user nova-compute[75018]:     </nova:instance>
Nov 07 15:38:56 user nova-compute[75018]:   </metadata>
Nov 07 15:38:56 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:38:56 user nova-compute[75018]:     <system>
Nov 07 15:38:56 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:38:56 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:38:56 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:38:56 user nova-compute[75018]:       <entry name="serial">e4ad018d-bdc7-458b-9e77-ba31457e52ff</entry>
Nov 07 15:38:56 user nova-compute[75018]:       <entry name="uuid">e4ad018d-bdc7-458b-9e77-ba31457e52ff</entry>
Nov 07 15:38:56 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:38:56 user nova-compute[75018]:     </system>
Nov 07 15:38:56 user nova-compute[75018]:   </sysinfo>
Nov 07 15:38:56 user nova-compute[75018]:   <os>
Nov 07 15:38:56 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:38:56 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:38:56 user nova-compute[75018]:   </os>
Nov 07 15:38:56 user nova-compute[75018]:   <features>
Nov 07 15:38:56 user nova-compute[75018]:     <acpi/>
Nov 07 15:38:56 user nova-compute[75018]:     <apic/>
Nov 07 15:38:56 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:38:56 user nova-compute[75018]:   </features>
Nov 07 15:38:56 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:38:56 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:38:56 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:38:56 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:38:56 user nova-compute[75018]:   </clock>
Nov 07 15:38:56 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:38:56 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:38:56 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:38:56 user nova-compute[75018]:   </cpu>
Nov 07 15:38:56 user nova-compute[75018]:   <devices>
Nov 07 15:38:56 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:38:56 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:38:56 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.rescue"/>
Nov 07 15:38:56 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:38:56 user nova-compute[75018]:     </disk>
Nov 07 15:38:56 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:38:56 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:38:56 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk"/>
Nov 07 15:38:56 user nova-compute[75018]:       <target dev="vdb" bus="virtio"/>
Nov 07 15:38:56 user nova-compute[75018]:     </disk>
Nov 07 15:38:56 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:38:56 user nova-compute[75018]:       <mac address="fa:16:3e:a7:84:70"/>
Nov 07 15:38:56 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:38:56 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:38:56 user nova-compute[75018]:       <target dev="tap280fe9e4-a3"/>
Nov 07 15:38:56 user nova-compute[75018]:     </interface>
Nov 07 15:38:56 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:38:56 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/console.log" append="off"/>
Nov 07 15:38:56 user nova-compute[75018]:     </serial>
Nov 07 15:38:56 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:38:56 user nova-compute[75018]:     <video>
Nov 07 15:38:56 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:38:56 user nova-compute[75018]:     </video>
Nov 07 15:38:56 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:38:56 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:38:56 user nova-compute[75018]:     </rng>
Nov 07 15:38:56 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:38:56 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:38:56 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:38:56 user nova-compute[75018]:     </memballoon>
Nov 07 15:38:56 user nova-compute[75018]:   </devices>
Nov 07 15:38:56 user nova-compute[75018]: </domain>
Nov 07 15:38:56 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:38:56 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Instance destroyed successfully.
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] No VIF found with MAC fa:16:3e:a7:84:70, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRgHLcFO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:38:56 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:38:56 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:38:56 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:38:56 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:38:56 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:38:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[305ee74c-a010-43f1-8cb7-64b749b223fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:38:56 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[309c774e-cd21-483e-a021-68073a62a891]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f] added
Nov 07 15:38:57 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[590abb66-b681-4125-aaeb-2d97d81c0ef4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[502c27d5-2e3b-464a-aed5-b5174cede949]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pRgHLcFO {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pRgHLcFO" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6185114b-22bd-4bb4-845f-b5ca25b162a4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pRgHLcFO'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c7181b-5273-4436-8205-7122d2429f03]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb59571b-4d57-43f5-9c69-3977d55db0db]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:38:57 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:38:57 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:38:57 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:38:57 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fe496f-5811-4e51-839f-16cb40f18dc5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f, portal: 172.16.0.220,3260]
Nov 07 15:38:57 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f, portal: 172.16.0.220,3260] successful.
Nov 07 15:38:57 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0345251f-7342-4911-81ff-55865355d2aa]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e268c0-077b-48c6-9b08-d2e90c31f075]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:38:57 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:38:57 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:38:57 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:38:57 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:38:57 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:38:57 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[77137577-e3b7-4f23-9162-187bb38d59ee]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRgHLcFO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "16453b1b-908e-4e7e-8596-7fc4211d5cea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "16453b1b-908e-4e7e-8596-7fc4211d5cea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:38:57 user nova-compute[75018]: INFO nova.compute.claims [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Claim successful on node user
Nov 07 15:38:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-e6aea919-5919-41c1-8f17-7753679a6b5b req-02cad2b4-d2df-4a91-9efb-04cef55d9478 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e6aea919-5919-41c1-8f17-7753679a6b5b req-02cad2b4-d2df-4a91-9efb-04cef55d9478 service nova] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e6aea919-5919-41c1-8f17-7753679a6b5b req-02cad2b4-d2df-4a91-9efb-04cef55d9478 service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e6aea919-5919-41c1-8f17-7753679a6b5b req-02cad2b4-d2df-4a91-9efb-04cef55d9478 service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-e6aea919-5919-41c1-8f17-7753679a6b5b req-02cad2b4-d2df-4a91-9efb-04cef55d9478 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] No waiting events found dispatching network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:38:57 user nova-compute[75018]: WARNING nova.compute.manager [req-e6aea919-5919-41c1-8f17-7753679a6b5b req-02cad2b4-d2df-4a91-9efb-04cef55d9478 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received unexpected event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b for instance with vm_state active and task_state rescuing.
Nov 07 15:38:57 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:58 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:38:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:38:58 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:38:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:38:58 user nova-compute[75018]: INFO nova.virt.block_device [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Booting with volume snapshot 7be6d338-fe2b-4951-8525-f26d467dbfd8 at /dev/vda
Nov 07 15:38:58 user nova-compute[75018]: DEBUG nova.policy [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ae23950e1e84c9693f8098c270ecb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772e759d9a1d4d18ae43f53c731f87f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:38:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:38:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23535633066653438', 'path': '/dev/sdd'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:38:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535633066653438', 'path': '/dev/sdd'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:38:58 user nova-compute[75018]: DEBUG nova.objects.instance [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lazy-loading 'flavor' on Instance uuid 98c33773-942b-422b-b4fd-a2b548260c09 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:38:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:38:58 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:38:58 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:38:58 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:38:58 user nova-compute[75018]:   <serial>9cfc9935-3bd0-4df5-a4da-9ca480821b6f</serial>
Nov 07 15:38:58 user nova-compute[75018]: </disk>
Nov 07 15:38:58 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:38:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:38:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:38:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:38:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] No VIF found with MAC fa:16:3e:6f:c7:ae, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Successfully created port: 6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG nova.compute.manager [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-60c8654f-7f9c-451a-891d-5b86000830bd tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.242s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:38:59 user nova-compute[75018]: INFO nova.compute.claims [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Claim successful on node user
Nov 07 15:38:59 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-8a144010-b17f-4f0e-82ce-116c8ec3395c req-45aed5c0-5ef3-4915-b1f0-247dfe64b938 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8a144010-b17f-4f0e-82ce-116c8ec3395c req-45aed5c0-5ef3-4915-b1f0-247dfe64b938 service nova] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8a144010-b17f-4f0e-82ce-116c8ec3395c req-45aed5c0-5ef3-4915-b1f0-247dfe64b938 service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8a144010-b17f-4f0e-82ce-116c8ec3395c req-45aed5c0-5ef3-4915-b1f0-247dfe64b938 service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-8a144010-b17f-4f0e-82ce-116c8ec3395c req-45aed5c0-5ef3-4915-b1f0-247dfe64b938 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] No waiting events found dispatching network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:38:59 user nova-compute[75018]: WARNING nova.compute.manager [req-8a144010-b17f-4f0e-82ce-116c8ec3395c req-45aed5c0-5ef3-4915-b1f0-247dfe64b938 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received unexpected event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b for instance with vm_state active and task_state rescuing.
Nov 07 15:38:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-8a144010-b17f-4f0e-82ce-116c8ec3395c req-45aed5c0-5ef3-4915-b1f0-247dfe64b938 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8a144010-b17f-4f0e-82ce-116c8ec3395c req-45aed5c0-5ef3-4915-b1f0-247dfe64b938 service nova] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8a144010-b17f-4f0e-82ce-116c8ec3395c req-45aed5c0-5ef3-4915-b1f0-247dfe64b938 service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8a144010-b17f-4f0e-82ce-116c8ec3395c req-45aed5c0-5ef3-4915-b1f0-247dfe64b938 service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-8a144010-b17f-4f0e-82ce-116c8ec3395c req-45aed5c0-5ef3-4915-b1f0-247dfe64b938 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] No waiting events found dispatching network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:38:59 user nova-compute[75018]: WARNING nova.compute.manager [req-8a144010-b17f-4f0e-82ce-116c8ec3395c req-45aed5c0-5ef3-4915-b1f0-247dfe64b938 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received unexpected event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b for instance with vm_state active and task_state rescuing.
Nov 07 15:38:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.711s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG nova.compute.manager [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG nova.compute.manager [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG nova.network.neutron [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Successfully updated port: 6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:38:59 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:38:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "refresh_cache-16453b1b-908e-4e7e-8596-7fc4211d5cea" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquired lock "refresh_cache-16453b1b-908e-4e7e-8596-7fc4211d5cea" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:38:59 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-08834f87-bef8-4a1a-ac44-0ab728558a3b req-8bc257be-f3ad-4f44-a871-b666bd9c1180 service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Received event network-changed-6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-08834f87-bef8-4a1a-ac44-0ab728558a3b req-8bc257be-f3ad-4f44-a871-b666bd9c1180 service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Refreshing instance network info cache due to event network-changed-6c145764-6875-4749-910d-69dff1c5f6cb. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-08834f87-bef8-4a1a-ac44-0ab728558a3b req-8bc257be-f3ad-4f44-a871-b666bd9c1180 service nova] Acquiring lock "refresh_cache-16453b1b-908e-4e7e-8596-7fc4211d5cea" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG nova.policy [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6b39ca6e2db4be9a71fca8389bce83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da5c809b9e14547855ac986915e8c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:39:00 user nova-compute[75018]: INFO nova.virt.block_device [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Booting with volume f217d4a6-0a2e-4da7-890e-edb3c57426ee at /dev/vda
Nov 07 15:39:00 user nova-compute[75018]: DEBUG os_brick.utils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[94607f16-73a9-4b12-81f5-94f3cf49a221]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b14ca0-8c80-40e3-87df-5d3849465fb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78fee0b-8b85-4261-8a8d-b4f2657a7f91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8d8a2c-b751-423b-8c4e-7f6e0d778a99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:39:00 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cd9839-73ab-4a19-b5b3-78bf266f4f00]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG os_brick.utils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Updating existing volume attachment record: ce75ddbd-3fa1-41ff-ac41-43d082e21765 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG nova.network.neutron [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Updating instance_info_cache with network_info: [{"id": "6c145764-6875-4749-910d-69dff1c5f6cb", "address": "fa:16:3e:9c:0d:6e", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c145764-68", "ovs_interfaceid": "6c145764-6875-4749-910d-69dff1c5f6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Releasing lock "refresh_cache-16453b1b-908e-4e7e-8596-7fc4211d5cea" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Instance network_info: |[{"id": "6c145764-6875-4749-910d-69dff1c5f6cb", "address": "fa:16:3e:9c:0d:6e", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c145764-68", "ovs_interfaceid": "6c145764-6875-4749-910d-69dff1c5f6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-08834f87-bef8-4a1a-ac44-0ab728558a3b req-8bc257be-f3ad-4f44-a871-b666bd9c1180 service nova] Acquired lock "refresh_cache-16453b1b-908e-4e7e-8596-7fc4211d5cea" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG nova.network.neutron [req-08834f87-bef8-4a1a-ac44-0ab728558a3b req-8bc257be-f3ad-4f44-a871-b666bd9c1180 service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Refreshing network info cache for port 6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ac74c2e0-33a1-4f15-a74e-7514e50c8ca4 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:00 user nova-compute[75018]: DEBUG nova.network.neutron [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Successfully created port: 83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:39:01 user nova-compute[75018]: DEBUG nova.network.neutron [req-08834f87-bef8-4a1a-ac44-0ab728558a3b req-8bc257be-f3ad-4f44-a871-b666bd9c1180 service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Updated VIF entry in instance network info cache for port 6c145764-6875-4749-910d-69dff1c5f6cb. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:39:01 user nova-compute[75018]: DEBUG nova.network.neutron [req-08834f87-bef8-4a1a-ac44-0ab728558a3b req-8bc257be-f3ad-4f44-a871-b666bd9c1180 service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Updating instance_info_cache with network_info: [{"id": "6c145764-6875-4749-910d-69dff1c5f6cb", "address": "fa:16:3e:9c:0d:6e", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c145764-68", "ovs_interfaceid": "6c145764-6875-4749-910d-69dff1c5f6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:39:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-08834f87-bef8-4a1a-ac44-0ab728558a3b req-8bc257be-f3ad-4f44-a871-b666bd9c1180 service nova] Releasing lock "refresh_cache-16453b1b-908e-4e7e-8596-7fc4211d5cea" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:39:01 user nova-compute[75018]: DEBUG nova.network.neutron [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Successfully updated port: 83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:39:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:39:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquired lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:39:01 user nova-compute[75018]: DEBUG nova.network.neutron [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:39:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-8e83a457-d8d4-49f7-bbc8-bab837488bcd req-bbaf459b-cdc4-4700-9b62-c4645db52823 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received event network-changed-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:39:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-8e83a457-d8d4-49f7-bbc8-bab837488bcd req-bbaf459b-cdc4-4700-9b62-c4645db52823 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Refreshing instance network info cache due to event network-changed-83dd20e9-5978-4447-b595-18937fab35d5. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:39:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8e83a457-d8d4-49f7-bbc8-bab837488bcd req-bbaf459b-cdc4-4700-9b62-c4645db52823 service nova] Acquiring lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:39:01 user nova-compute[75018]: DEBUG nova.network.neutron [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:39:02 user nova-compute[75018]: DEBUG nova.network.neutron [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Updating instance_info_cache with network_info: [{"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:39:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Releasing lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:39:02 user nova-compute[75018]: DEBUG nova.compute.manager [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Instance network_info: |[{"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:39:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8e83a457-d8d4-49f7-bbc8-bab837488bcd req-bbaf459b-cdc4-4700-9b62-c4645db52823 service nova] Acquired lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:39:02 user nova-compute[75018]: DEBUG nova.network.neutron [req-8e83a457-d8d4-49f7-bbc8-bab837488bcd req-bbaf459b-cdc4-4700-9b62-c4645db52823 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Refreshing network info cache for port 83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:39:02 user nova-compute[75018]: DEBUG nova.network.neutron [req-8e83a457-d8d4-49f7-bbc8-bab837488bcd req-bbaf459b-cdc4-4700-9b62-c4645db52823 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Updated VIF entry in instance network info cache for port 83dd20e9-5978-4447-b595-18937fab35d5. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:39:02 user nova-compute[75018]: DEBUG nova.network.neutron [req-8e83a457-d8d4-49f7-bbc8-bab837488bcd req-bbaf459b-cdc4-4700-9b62-c4645db52823 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Updating instance_info_cache with network_info: [{"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:39:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8e83a457-d8d4-49f7-bbc8-bab837488bcd req-bbaf459b-cdc4-4700-9b62-c4645db52823 service nova] Releasing lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:39:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "98c33773-942b-422b-b4fd-a2b548260c09" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:39:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:39:02 user nova-compute[75018]: DEBUG nova.objects.instance [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lazy-loading 'flavor' on Instance uuid 98c33773-942b-422b-b4fd-a2b548260c09 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:39:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "98c33773-942b-422b-b4fd-a2b548260c09" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:39:03 user nova-compute[75018]: INFO nova.compute.manager [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Attaching volume 480a7dfb-992a-4dee-a4fd-e270136c0e62 to /dev/vdc
Nov 07 15:39:03 user nova-compute[75018]: DEBUG os_brick.utils [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[55848b24-54eb-4111-aeb5-7d45da808706]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9cd287-1a59-4b03-a16c-bb14979b7f86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[24457199-cc99-479b-98c6-6857c211653f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadf86ce-f0b7-4bcb-8956-d63535573d80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:39:03 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:39:03 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab35e6d5-796d-4bec-9119-fa620004b9a2]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG os_brick.utils [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Updating existing volume attachment record: d610dbc4-96d9-40f2-9114-0f599802cb59 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:39:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG os_brick.utils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea4f56b-b474-4875-a83b-1e604c05f829]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e67233-ed0f-4fd7-b8a4-07c93e17e62e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[123dce67-4eef-4803-b71f-2ac94fd04d3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[92965d70-a607-46cb-a229-a5f9f472734d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:39:09 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:39:09 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b265a182-fbd2-4ff8-8d21-190fa5d01547]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG os_brick.utils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:39:09 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Updating existing volume attachment record: e59fb8e4-f6a0-4fa8-aa8c-eff51c6f66cc {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:39:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:39:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:39:25 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Creating image(s)
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Did not create local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Ensure instance console log exists: /opt/stack/data/nova/instances/da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Start _get_guest_xml network_info=[{"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxOItsEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb', 'attached_at': '', 'detached_at': '', 'volume_id': 'f217d4a6-0a2e-4da7-890e-edb3c57426ee', 'serial': 'f217d4a6-0a2e-4da7-890e-edb3c57426ee'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'ce75ddbd-3fa1-41ff-ac41-43d082e21765', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:39:25 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:39:25 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxOItsEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:39:25 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:39:25 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:39:25 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4757e379-18b6-4e44-9d8e-6620d5f7a0de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:39:25 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2884c4f7-13ae-4ae5-aa00-7bf7e14f95a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee] added
Nov 07 15:39:25 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[318ce62e-c011-45e8-9f8f-217b55690142]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf756a6-eefe-4565-b1ec-c0eac8a3a57f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxOItsEA {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxOItsEA" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[df25f70b-7122-4103-9b7b-0d72199b9d08]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LxOItsEA'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1ede70-d772-4a1b-8f17-60ba63fc71cd]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc3ed07-5d2d-4869-a550-08d6294fe379]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:39:25 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:39:25 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:39:25 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:39:25 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:39:25 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:39:25 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54369a6-b055-42dc-802a-625206e5d64e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260]
Nov 07 15:39:25 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260] successful.
Nov 07 15:39:25 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d12305b-b052-4dc1-8bd8-de0e3bee6bda]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dd121c-4ef8-488f-9306-1f9666ff7868]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:39:25 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:39:25 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:39:25 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:39:25 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:39:25 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:39:25 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:39:25 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:39:25 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5dd395-b9d3-4ae9-aaf7-756d95c939ae]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:39:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxOItsEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23336636633623034', 'path': '/dev/sde'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336636633623034', 'path': '/dev/sde'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-68415212',display_name='tempest-ServerActionsTestOtherA-server-68415212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-68415212',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWUuR4eTrthHIodCYA4J9kJfg+RXJSyXAWybmq/Ac2FttoM8S/nLdDec5RLFtfiG+hcM5DvHo1f+xa7mxv4L56s6Q3dpUvRcBzbdTOGBBvgSiAYU0HY5RSxW2+5w/RcXA==',key_name='tempest-keypair-2049594144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-xtwasur4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:39:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=83dd20e9-5978-4447-b595-18937fab35d5,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dd20e9-59') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG nova.objects.instance [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lazy-loading 'pci_devices' on Instance uuid da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:39:26 user nova-compute[75018]:   <uuid>da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb</uuid>
Nov 07 15:39:26 user nova-compute[75018]:   <name>instance-00000023</name>
Nov 07 15:39:26 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:39:26 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:39:26 user nova-compute[75018]:   <metadata>
Nov 07 15:39:26 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:39:26 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:39:26 user nova-compute[75018]:       <nova:name>tempest-ServerActionsTestOtherA-server-68415212</nova:name>
Nov 07 15:39:26 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:39:25</nova:creationTime>
Nov 07 15:39:26 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:39:26 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:39:26 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:39:26 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:39:26 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:39:26 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:39:26 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:39:26 user nova-compute[75018]:       <nova:owner>
Nov 07 15:39:26 user nova-compute[75018]:         <nova:user uuid="c6b39ca6e2db4be9a71fca8389bce83f">tempest-ServerActionsTestOtherA-1198683339-project-member</nova:user>
Nov 07 15:39:26 user nova-compute[75018]:         <nova:project uuid="8da5c809b9e14547855ac986915e8c99">tempest-ServerActionsTestOtherA-1198683339</nova:project>
Nov 07 15:39:26 user nova-compute[75018]:       </nova:owner>
Nov 07 15:39:26 user nova-compute[75018]:       <nova:ports>
Nov 07 15:39:26 user nova-compute[75018]:         <nova:port uuid="83dd20e9-5978-4447-b595-18937fab35d5">
Nov 07 15:39:26 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 07 15:39:26 user nova-compute[75018]:         </nova:port>
Nov 07 15:39:26 user nova-compute[75018]:       </nova:ports>
Nov 07 15:39:26 user nova-compute[75018]:     </nova:instance>
Nov 07 15:39:26 user nova-compute[75018]:   </metadata>
Nov 07 15:39:26 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:39:26 user nova-compute[75018]:     <system>
Nov 07 15:39:26 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:39:26 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:39:26 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:39:26 user nova-compute[75018]:       <entry name="serial">da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb</entry>
Nov 07 15:39:26 user nova-compute[75018]:       <entry name="uuid">da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb</entry>
Nov 07 15:39:26 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:39:26 user nova-compute[75018]:     </system>
Nov 07 15:39:26 user nova-compute[75018]:   </sysinfo>
Nov 07 15:39:26 user nova-compute[75018]:   <os>
Nov 07 15:39:26 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:39:26 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:39:26 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:39:26 user nova-compute[75018]:   </os>
Nov 07 15:39:26 user nova-compute[75018]:   <features>
Nov 07 15:39:26 user nova-compute[75018]:     <acpi/>
Nov 07 15:39:26 user nova-compute[75018]:     <apic/>
Nov 07 15:39:26 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:39:26 user nova-compute[75018]:   </features>
Nov 07 15:39:26 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:39:26 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:39:26 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:39:26 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:39:26 user nova-compute[75018]:   </clock>
Nov 07 15:39:26 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:39:26 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:39:26 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:39:26 user nova-compute[75018]:   </cpu>
Nov 07 15:39:26 user nova-compute[75018]:   <devices>
Nov 07 15:39:26 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:39:26 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:39:26 user nova-compute[75018]:       <source dev="/dev/sde"/>
Nov 07 15:39:26 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:39:26 user nova-compute[75018]:       <serial>f217d4a6-0a2e-4da7-890e-edb3c57426ee</serial>
Nov 07 15:39:26 user nova-compute[75018]:     </disk>
Nov 07 15:39:26 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:39:26 user nova-compute[75018]:       <mac address="fa:16:3e:a4:c0:dc"/>
Nov 07 15:39:26 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:39:26 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:39:26 user nova-compute[75018]:       <target dev="tap83dd20e9-59"/>
Nov 07 15:39:26 user nova-compute[75018]:     </interface>
Nov 07 15:39:26 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:39:26 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb/console.log" append="off"/>
Nov 07 15:39:26 user nova-compute[75018]:     </serial>
Nov 07 15:39:26 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:39:26 user nova-compute[75018]:     <video>
Nov 07 15:39:26 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:39:26 user nova-compute[75018]:     </video>
Nov 07 15:39:26 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:39:26 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:39:26 user nova-compute[75018]:     </rng>
Nov 07 15:39:26 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:39:26 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:39:26 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:39:26 user nova-compute[75018]:     </memballoon>
Nov 07 15:39:26 user nova-compute[75018]:   </devices>
Nov 07 15:39:26 user nova-compute[75018]: </domain>
Nov 07 15:39:26 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-68415212',display_name='tempest-ServerActionsTestOtherA-server-68415212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-68415212',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWUuR4eTrthHIodCYA4J9kJfg+RXJSyXAWybmq/Ac2FttoM8S/nLdDec5RLFtfiG+hcM5DvHo1f+xa7mxv4L56s6Q3dpUvRcBzbdTOGBBvgSiAYU0HY5RSxW2+5w/RcXA==',key_name='tempest-keypair-2049594144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-xtwasur4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:39:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=83dd20e9-5978-4447-b595-18937fab35d5,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dd20e9-59') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG os_vif [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=83dd20e9-5978-4447-b595-18937fab35d5,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dd20e9-59') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dc78e59-6ab1-5125-86d3-82e4f5ba0c51', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83dd20e9-59, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83dd20e9-59, col_values=(('qos', UUID('b41ac417-3400-40a3-9bdc-f244d6215b81')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83dd20e9-59, col_values=(('external_ids', {'iface-id': '83dd20e9-5978-4447-b595-18937fab35d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:c0:dc', 'vm-uuid': 'da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:26 user nova-compute[75018]: INFO os_vif [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=83dd20e9-5978-4447-b595-18937fab35d5,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dd20e9-59')
Nov 07 15:39:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:39:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] No VIF found with MAC fa:16:3e:a4:c0:dc, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNIMhqvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:39:27 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:39:27 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:39:27 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[450e578b-06f5-4dcc-aa5d-c572cf5ca94a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:39:27 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e989d733-2b3e-4ab7-be74-63e8034bf102]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62] added
Nov 07 15:39:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d062626d-b3e6-4292-a63b-d5827129d84f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f79b53-6949-49f5-952d-89f4bf1695dc]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNIMhqvB {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNIMhqvB" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[568b1d0f-cbeb-4581-8d32-a29933b8bf47]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kNIMhqvB'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bcbb14-e27e-4b14-91a2-6beedfe129c7]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5ee80f-495c-42f5-b7ef-5b3cbeb48ffa]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:39:27 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:39:27 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:39:27 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:39:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:39:27 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:39:27 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:39:27 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:39:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[11da5ad6-6254-4b93-8ec6-5498812225c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62, portal: 172.16.0.220,3260]
Nov 07 15:39:27 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62, portal: 172.16.0.220,3260] successful.
Nov 07 15:39:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7b8aed-4a89-440c-ac79-597f8d14e1bb]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3006c7db-d9f4-4b14-8e5d-28e558b255b1]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:39:27 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:39:27 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:39:27 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:39:27 user nova-compute[75018]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 (non-flash)
Nov 07 15:39:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:39:27 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:39:27 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:39:27 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:39:27 user nova-compute[75018]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 (non-flash)
Nov 07 15:39:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feb2642-920c-433b-90ac-5e3fbd98c198]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:39:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNIMhqvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:39:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-0f715767-85a9-4527-8f2c-63852bead0af req-c81bcce1-81be-4173-ba74-d029ad282407 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received event network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:39:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0f715767-85a9-4527-8f2c-63852bead0af req-c81bcce1-81be-4173-ba74-d029ad282407 service nova] Acquiring lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:39:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0f715767-85a9-4527-8f2c-63852bead0af req-c81bcce1-81be-4173-ba74-d029ad282407 service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:39:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0f715767-85a9-4527-8f2c-63852bead0af req-c81bcce1-81be-4173-ba74-d029ad282407 service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:39:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-0f715767-85a9-4527-8f2c-63852bead0af req-c81bcce1-81be-4173-ba74-d029ad282407 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] No waiting events found dispatching network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:39:28 user nova-compute[75018]: WARNING nova.compute.manager [req-0f715767-85a9-4527-8f2c-63852bead0af req-c81bcce1-81be-4173-ba74-d029ad282407 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received unexpected event network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 for instance with vm_state building and task_state spawning.
Nov 07 15:39:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:39:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23862386366313236', 'path': '/dev/sdf'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:39:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862386366313236', 'path': '/dev/sdf'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:39:28 user nova-compute[75018]: DEBUG nova.objects.instance [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lazy-loading 'flavor' on Instance uuid 98c33773-942b-422b-b4fd-a2b548260c09 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:39:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:39:28 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:39:28 user nova-compute[75018]:   <source dev="/dev/sdf"/>
Nov 07 15:39:28 user nova-compute[75018]:   <target dev="vdc" bus="virtio"/>
Nov 07 15:39:28 user nova-compute[75018]:   <serial>480a7dfb-992a-4dee-a4fd-e270136c0e62</serial>
Nov 07 15:39:28 user nova-compute[75018]: </disk>
Nov 07 15:39:28 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:39:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:39:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:39:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:39:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] No VIF found with MAC fa:16:3e:6f:c7:ae, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:39:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-730936ac-a7e5-4e02-8d46-f4fa4b0de1aa tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.332s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:39:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:39:30 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Instance spawned successfully.
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-0722a8c2-394a-46c7-8f71-1316257ebfc8 req-6839cf6d-020c-4fbf-95e3-a2a136296c0c service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received event network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0722a8c2-394a-46c7-8f71-1316257ebfc8 req-6839cf6d-020c-4fbf-95e3-a2a136296c0c service nova] Acquiring lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0722a8c2-394a-46c7-8f71-1316257ebfc8 req-6839cf6d-020c-4fbf-95e3-a2a136296c0c service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0722a8c2-394a-46c7-8f71-1316257ebfc8 req-6839cf6d-020c-4fbf-95e3-a2a136296c0c service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-0722a8c2-394a-46c7-8f71-1316257ebfc8 req-6839cf6d-020c-4fbf-95e3-a2a136296c0c service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] No waiting events found dispatching network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:39:30 user nova-compute[75018]: WARNING nova.compute.manager [req-0722a8c2-394a-46c7-8f71-1316257ebfc8 req-6839cf6d-020c-4fbf-95e3-a2a136296c0c service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received unexpected event network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 for instance with vm_state building and task_state spawning.
Nov 07 15:39:30 user nova-compute[75018]: INFO nova.compute.manager [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:39:30 user nova-compute[75018]: INFO nova.compute.manager [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Took 31.72 seconds to build instance.
Nov 07 15:39:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "98c33773-942b-422b-b4fd-a2b548260c09" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d428ca57-2863-405f-a5f7-a68dbd8d4b98 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.833s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:39:30 user nova-compute[75018]: INFO nova.compute.manager [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Detaching volume 480a7dfb-992a-4dee-a4fd-e270136c0e62
Nov 07 15:39:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:30 user nova-compute[75018]: INFO nova.virt.block_device [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Attempting to driver detach volume 480a7dfb-992a-4dee-a4fd-e270136c0e62 from mountpoint /dev/vdc
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Attempting to detach device vdc from instance 98c33773-942b-422b-b4fd-a2b548260c09 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:39:30 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:39:30 user nova-compute[75018]:   <source dev="/dev/sdf"/>
Nov 07 15:39:30 user nova-compute[75018]:   <target dev="vdc" bus="virtio"/>
Nov 07 15:39:30 user nova-compute[75018]:   <serial>480a7dfb-992a-4dee-a4fd-e270136c0e62</serial>
Nov 07 15:39:30 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 07 15:39:30 user nova-compute[75018]: </disk>
Nov 07 15:39:30 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:39:30 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Successfully detached device vdc from instance 98c33773-942b-422b-b4fd-a2b548260c09 from the persistent domain config.
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 98c33773-942b-422b-b4fd-a2b548260c09 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:39:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:39:30 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:39:30 user nova-compute[75018]:   <source dev="/dev/sdf"/>
Nov 07 15:39:30 user nova-compute[75018]:   <target dev="vdc" bus="virtio"/>
Nov 07 15:39:30 user nova-compute[75018]:   <serial>480a7dfb-992a-4dee-a4fd-e270136c0e62</serial>
Nov 07 15:39:30 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 07 15:39:30 user nova-compute[75018]: </disk>
Nov 07 15:39:30 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:39:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 98c33773-942b-422b-b4fd-a2b548260c09 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:39:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:39:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:39:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:39:31 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:39:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:33 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:39:35 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Creating image(s)
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Did not create local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Ensure instance console log exists: /opt/stack/data/nova/instances/16453b1b-908e-4e7e-8596-7fc4211d5cea/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Start _get_guest_xml network_info=[{"id": "6c145764-6875-4749-910d-69dff1c5f6cb", "address": "fa:16:3e:9c:0d:6e", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c145764-68", "ovs_interfaceid": "6c145764-6875-4749-910d-69dff1c5f6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-07T15:38:42Z,direct_url=<?>,disk_format='qcow2',id=50ed591c-a29e-4dca-ace0-8644fa67b0b9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1909891739',owner='772e759d9a1d4d18ae43f53c731f87f2',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-07T15:38:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdTPluro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '16453b1b-908e-4e7e-8596-7fc4211d5cea', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb54521f-56ea-436c-b762-cac0c6738c96', 'serial': 'fb54521f-56ea-436c-b762-cac0c6738c96'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'e59fb8e4-f6a0-4fa8-aa8c-eff51c6f66cc', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:39:35 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:39:35 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-07T15:38:42Z,direct_url=<?>,disk_format='qcow2',id=50ed591c-a29e-4dca-ace0-8644fa67b0b9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1909891739',owner='772e759d9a1d4d18ae43f53c731f87f2',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-07T15:38:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdTPluro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:39:35 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:39:35 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:39:35 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3cf188-e5ee-413c-86f3-9845cabc178c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:39:35 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0ba4d3-cd3c-4dd9-afd4-ce77a7ae58bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96] added
Nov 07 15:39:35 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[131ef2f0-e7ee-4a01-ad71-bc28f5d6f551]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff837c09-6854-42ad-bfca-3c94f148fab1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BdTPluro {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BdTPluro" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd385cc1-cb2f-415b-9e21-9f000876f6d2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BdTPluro'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[174a73f5-ef3f-4790-ad00-61754fb93e7d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bc7594-b72f-4b6a-8a20-8e31773ced1c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 (non-flash)
Nov 07 15:39:35 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 (non-flash)
Nov 07 15:39:35 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d61961f-22e6-4f83-a051-998bbf501266]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96, portal: 172.16.0.220,3260]
Nov 07 15:39:35 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96, portal: 172.16.0.220,3260] successful.
Nov 07 15:39:35 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a758fb-7e06-4cd2-80ee-f10d3d07d580]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf02bbea-3921-429d-bb92-49a3f598bf45]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:39:35 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 (non-flash)
Nov 07 15:39:35 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:39:35 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a8f9c7-b3e5-4e1d-b369-314dd4417104]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:39:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdTPluro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26530346466396334', 'path': '/dev/sdg'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530346466396334', 'path': '/dev/sdg'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1228903760',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1228903760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1228903760',id=34,image_ref='50ed591c-a29e-4dca-ace0-8644fa67b0b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRH6KYnrTQrrfnmKgoscAyw0xHucdagkv5LPvRqwtQUpnijSJQsr7GSFT6wBQ3lB2p613P3iY/a7lSnYFW+g8+wQrLx+3j+q88dzf+xKuOCOPxdPjJEhL7DtNtXXUMEAA==',key_name='tempest-keypair-1580684035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772e759d9a1d4d18ae43f53c731f87f2',ramdisk_id='',reservation_id='r-ryi8yqjt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1644595019',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1644595019',owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ae23950e1e84c9693f8098c270ecb55',uuid=16453b1b-908e-4e7e-8596-7fc4211d5cea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c145764-6875-4749-910d-69dff1c5f6cb", "address": "fa:16:3e:9c:0d:6e", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c145764-68", "ovs_interfaceid": "6c145764-6875-4749-910d-69dff1c5f6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converting VIF {"id": "6c145764-6875-4749-910d-69dff1c5f6cb", "address": "fa:16:3e:9c:0d:6e", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c145764-68", "ovs_interfaceid": "6c145764-6875-4749-910d-69dff1c5f6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:0d:6e,bridge_name='br-int',has_traffic_filtering=True,id=6c145764-6875-4749-910d-69dff1c5f6cb,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c145764-68') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG nova.objects.instance [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lazy-loading 'pci_devices' on Instance uuid 16453b1b-908e-4e7e-8596-7fc4211d5cea {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:39:36 user nova-compute[75018]:   <uuid>16453b1b-908e-4e7e-8596-7fc4211d5cea</uuid>
Nov 07 15:39:36 user nova-compute[75018]:   <name>instance-00000022</name>
Nov 07 15:39:36 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:39:36 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:39:36 user nova-compute[75018]:   <metadata>
Nov 07 15:39:36 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:39:36 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:39:36 user nova-compute[75018]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1228903760</nova:name>
Nov 07 15:39:36 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:39:35</nova:creationTime>
Nov 07 15:39:36 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:39:36 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:39:36 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:39:36 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:39:36 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:39:36 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:39:36 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:39:36 user nova-compute[75018]:       <nova:owner>
Nov 07 15:39:36 user nova-compute[75018]:         <nova:user uuid="3ae23950e1e84c9693f8098c270ecb55">tempest-TestVolumeBootPattern-1644595019-project-member</nova:user>
Nov 07 15:39:36 user nova-compute[75018]:         <nova:project uuid="772e759d9a1d4d18ae43f53c731f87f2">tempest-TestVolumeBootPattern-1644595019</nova:project>
Nov 07 15:39:36 user nova-compute[75018]:       </nova:owner>
Nov 07 15:39:36 user nova-compute[75018]:       <nova:root type="image" uuid="50ed591c-a29e-4dca-ace0-8644fa67b0b9"/>
Nov 07 15:39:36 user nova-compute[75018]:       <nova:ports>
Nov 07 15:39:36 user nova-compute[75018]:         <nova:port uuid="6c145764-6875-4749-910d-69dff1c5f6cb">
Nov 07 15:39:36 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 07 15:39:36 user nova-compute[75018]:         </nova:port>
Nov 07 15:39:36 user nova-compute[75018]:       </nova:ports>
Nov 07 15:39:36 user nova-compute[75018]:     </nova:instance>
Nov 07 15:39:36 user nova-compute[75018]:   </metadata>
Nov 07 15:39:36 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:39:36 user nova-compute[75018]:     <system>
Nov 07 15:39:36 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:39:36 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:39:36 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:39:36 user nova-compute[75018]:       <entry name="serial">16453b1b-908e-4e7e-8596-7fc4211d5cea</entry>
Nov 07 15:39:36 user nova-compute[75018]:       <entry name="uuid">16453b1b-908e-4e7e-8596-7fc4211d5cea</entry>
Nov 07 15:39:36 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:39:36 user nova-compute[75018]:     </system>
Nov 07 15:39:36 user nova-compute[75018]:   </sysinfo>
Nov 07 15:39:36 user nova-compute[75018]:   <os>
Nov 07 15:39:36 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:39:36 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:39:36 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:39:36 user nova-compute[75018]:   </os>
Nov 07 15:39:36 user nova-compute[75018]:   <features>
Nov 07 15:39:36 user nova-compute[75018]:     <acpi/>
Nov 07 15:39:36 user nova-compute[75018]:     <apic/>
Nov 07 15:39:36 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:39:36 user nova-compute[75018]:   </features>
Nov 07 15:39:36 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:39:36 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:39:36 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:39:36 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:39:36 user nova-compute[75018]:   </clock>
Nov 07 15:39:36 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:39:36 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:39:36 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:39:36 user nova-compute[75018]:   </cpu>
Nov 07 15:39:36 user nova-compute[75018]:   <devices>
Nov 07 15:39:36 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:39:36 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:39:36 user nova-compute[75018]:       <source dev="/dev/sdg"/>
Nov 07 15:39:36 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:39:36 user nova-compute[75018]:       <serial>fb54521f-56ea-436c-b762-cac0c6738c96</serial>
Nov 07 15:39:36 user nova-compute[75018]:     </disk>
Nov 07 15:39:36 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:39:36 user nova-compute[75018]:       <mac address="fa:16:3e:9c:0d:6e"/>
Nov 07 15:39:36 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:39:36 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:39:36 user nova-compute[75018]:       <target dev="tap6c145764-68"/>
Nov 07 15:39:36 user nova-compute[75018]:     </interface>
Nov 07 15:39:36 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:39:36 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/16453b1b-908e-4e7e-8596-7fc4211d5cea/console.log" append="off"/>
Nov 07 15:39:36 user nova-compute[75018]:     </serial>
Nov 07 15:39:36 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:39:36 user nova-compute[75018]:     <video>
Nov 07 15:39:36 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:39:36 user nova-compute[75018]:     </video>
Nov 07 15:39:36 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:39:36 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:39:36 user nova-compute[75018]:     </rng>
Nov 07 15:39:36 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:39:36 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:39:36 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:39:36 user nova-compute[75018]:     </memballoon>
Nov 07 15:39:36 user nova-compute[75018]:   </devices>
Nov 07 15:39:36 user nova-compute[75018]: </domain>
Nov 07 15:39:36 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1228903760',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1228903760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1228903760',id=34,image_ref='50ed591c-a29e-4dca-ace0-8644fa67b0b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRH6KYnrTQrrfnmKgoscAyw0xHucdagkv5LPvRqwtQUpnijSJQsr7GSFT6wBQ3lB2p613P3iY/a7lSnYFW+g8+wQrLx+3j+q88dzf+xKuOCOPxdPjJEhL7DtNtXXUMEAA==',key_name='tempest-keypair-1580684035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772e759d9a1d4d18ae43f53c731f87f2',ramdisk_id='',reservation_id='r-ryi8yqjt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1644595019',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1644595019',owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ae23950e1e84c9693f8098c270ecb55',uuid=16453b1b-908e-4e7e-8596-7fc4211d5cea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c145764-6875-4749-910d-69dff1c5f6cb", "address": "fa:16:3e:9c:0d:6e", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c145764-68", "ovs_interfaceid": "6c145764-6875-4749-910d-69dff1c5f6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converting VIF {"id": "6c145764-6875-4749-910d-69dff1c5f6cb", "address": "fa:16:3e:9c:0d:6e", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c145764-68", "ovs_interfaceid": "6c145764-6875-4749-910d-69dff1c5f6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:0d:6e,bridge_name='br-int',has_traffic_filtering=True,id=6c145764-6875-4749-910d-69dff1c5f6cb,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c145764-68') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG os_vif [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:0d:6e,bridge_name='br-int',has_traffic_filtering=True,id=6c145764-6875-4749-910d-69dff1c5f6cb,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c145764-68') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aee094a2-0f43-5475-8345-9ae006470478', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c145764-68, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c145764-68, col_values=(('qos', UUID('49876aa3-7899-4c18-9ba4-1bc31b26d464')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c145764-68, col_values=(('external_ids', {'iface-id': '6c145764-6875-4749-910d-69dff1c5f6cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:0d:6e', 'vm-uuid': '16453b1b-908e-4e7e-8596-7fc4211d5cea'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:36 user nova-compute[75018]: INFO os_vif [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:0d:6e,bridge_name='br-int',has_traffic_filtering=True,id=6c145764-6875-4749-910d-69dff1c5f6cb,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c145764-68')
Nov 07 15:39:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:39:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] No VIF found with MAC fa:16:3e:9c:0d:6e, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:39:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:39:37 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:39:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:39:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:39:37 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Updating instance_info_cache with network_info: [{"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-1e6465d9-6a61-4d6b-b876-ffdd9878fc28" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG nova.compute.manager [req-c2767ffe-114c-4a1d-8bd4-22537ad3ff8f req-8960bdd1-3b53-4324-863e-a78648e7e401 service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Received event network-vif-plugged-6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c2767ffe-114c-4a1d-8bd4-22537ad3ff8f req-8960bdd1-3b53-4324-863e-a78648e7e401 service nova] Acquiring lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c2767ffe-114c-4a1d-8bd4-22537ad3ff8f req-8960bdd1-3b53-4324-863e-a78648e7e401 service nova] Lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c2767ffe-114c-4a1d-8bd4-22537ad3ff8f req-8960bdd1-3b53-4324-863e-a78648e7e401 service nova] Lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG nova.compute.manager [req-c2767ffe-114c-4a1d-8bd4-22537ad3ff8f req-8960bdd1-3b53-4324-863e-a78648e7e401 service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] No waiting events found dispatching network-vif-plugged-6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:39:38 user nova-compute[75018]: WARNING nova.compute.manager [req-c2767ffe-114c-4a1d-8bd4-22537ad3ff8f req-8960bdd1-3b53-4324-863e-a78648e7e401 service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Received unexpected event network-vif-plugged-6c145764-6875-4749-910d-69dff1c5f6cb for instance with vm_state building and task_state spawning.
Nov 07 15:39:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:39:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:39:40 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Instance spawned successfully.
Nov 07 15:39:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:39:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:39:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:39:40 user nova-compute[75018]: DEBUG nova.compute.manager [req-d7067c8c-132e-4a89-8cad-6bfdd4f5ca4e req-785cbd84-c6af-46da-aa8c-f14c4151d07d service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Received event network-vif-plugged-6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:39:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d7067c8c-132e-4a89-8cad-6bfdd4f5ca4e req-785cbd84-c6af-46da-aa8c-f14c4151d07d service nova] Acquiring lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:39:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d7067c8c-132e-4a89-8cad-6bfdd4f5ca4e req-785cbd84-c6af-46da-aa8c-f14c4151d07d service nova] Lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:39:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d7067c8c-132e-4a89-8cad-6bfdd4f5ca4e req-785cbd84-c6af-46da-aa8c-f14c4151d07d service nova] Lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:39:40 user nova-compute[75018]: DEBUG nova.compute.manager [req-d7067c8c-132e-4a89-8cad-6bfdd4f5ca4e req-785cbd84-c6af-46da-aa8c-f14c4151d07d service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] No waiting events found dispatching network-vif-plugged-6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:39:40 user nova-compute[75018]: WARNING nova.compute.manager [req-d7067c8c-132e-4a89-8cad-6bfdd4f5ca4e req-785cbd84-c6af-46da-aa8c-f14c4151d07d service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Received unexpected event network-vif-plugged-6c145764-6875-4749-910d-69dff1c5f6cb for instance with vm_state building and task_state spawning.
Nov 07 15:39:40 user nova-compute[75018]: INFO nova.compute.manager [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 07 15:39:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:39:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:40 user nova-compute[75018]: INFO nova.compute.manager [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Took 43.26 seconds to build instance.
Nov 07 15:39:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0b00072e-af80-4512-9ad0-2ec8d7d119ad tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "16453b1b-908e-4e7e-8596-7fc4211d5cea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.384s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:39:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:39:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:39:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:39:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:39:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json" returned: 0 in 0.410s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:39:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:45 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:39:45 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:39:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7504MB free_disk=25.047016143798828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 31e90a00-c2df-493c-9b7e-12d3063b877f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e4ad018d-bdc7-458b-9e77-ba31457e52ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 98c33773-942b-422b-b4fd-a2b548260c09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 4bf14e55-beb3-4800-8472-3436fa21b45e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1f86ee09-062b-428d-9870-14de77c569c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 79aba108-cfd6-4e83-99f5-50403a500a87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 16453b1b-908e-4e7e-8596-7fc4211d5cea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:39:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:46 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:39:46 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:39:46 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:39:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:39:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:48 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:39:48 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:39:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:51 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 98c33773-942b-422b-b4fd-a2b548260c09 is timed out.
Nov 07 15:39:51 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Successfully detached device vdc from instance 98c33773-942b-422b-b4fd-a2b548260c09 from the live domain config.
Nov 07 15:39:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNIMhqvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:39:51 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8c6846-d4c2-415e-8433-c45ae44032cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:39:51 user nova-compute[75018]: No targets found.
Nov 07 15:39:51 user nova-compute[75018]: iSNS:
Nov 07 15:39:51 user nova-compute[75018]: No targets found.
Nov 07 15:39:51 user nova-compute[75018]: STATIC:
Nov 07 15:39:51 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444
Nov 07 15:39:51 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:39:51 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:39:51 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee
Nov 07 15:39:51 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:39:51 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:39:51 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96
Nov 07 15:39:51 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:39:51 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:39:51 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823
Nov 07 15:39:51 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:39:51 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:39:51 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62
Nov 07 15:39:51 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:39:51 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:39:51 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f
Nov 07 15:39:51 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:39:51 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:39:51 user nova-compute[75018]: FIRMWARE:
Nov 07 15:39:51 user nova-compute[75018]: No targets found.
Nov 07 15:39:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:39:51 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:39:51 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b07c64-f8d6-49f4-a75d-e6a18778829c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b108b2-332b-47ee-af0e-d07e602a9a9e]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:39:51 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:39:51 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:39:51 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:39:51 user nova-compute[75018]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 (non-flash)
Nov 07 15:39:51 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:39:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:39:51 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:39:51 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:39:51 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:39:51 user nova-compute[75018]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 (non-flash)
Nov 07 15:39:51 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:39:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae06e0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62'): ({'sdf'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Removing single pathed devices sdf {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afe4950-3d81-41af-8a2b-0ac02128e005]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70df998-1bf3-49c3-9466-b850b9f65a63]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Flushing IO for device /dev/sdf {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f067999b-d3c2-466a-afa9-0f3a6a263222]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2d8fcd-d71c-4c47-ad6f-7adc1fa043a2]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] SCSI volumes sdf have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d755df8-a1f3-4fe8-a119-17e6de3f33f1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b62f78-336d-462b-b83b-333198a7f38e]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62, portal: 172.16.0.220,3260]
Nov 07 15:39:51 user nova-compute[75018]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62, portal: 172.16.0.220,3260] successful.
Nov 07 15:39:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480a7dfb-992a-4dee-a4fd-e270136c0e62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a410ed-e685-4b91-9910-9673bba7866f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] <== disconnect_volume: return (375ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:39:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-a2f2d50b-4829-43ca-994d-38d25c2b0064 req-701690bd-6306-4db6-a40c-de081e8ac3b7 service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Received event network-changed-58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-a2f2d50b-4829-43ca-994d-38d25c2b0064 req-701690bd-6306-4db6-a40c-de081e8ac3b7 service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Refreshing instance network info cache due to event network-changed-58e42c23-4f3b-4394-aa4f-42ae19671af0. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a2f2d50b-4829-43ca-994d-38d25c2b0064 req-701690bd-6306-4db6-a40c-de081e8ac3b7 service nova] Acquiring lock "refresh_cache-1f86ee09-062b-428d-9870-14de77c569c0" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a2f2d50b-4829-43ca-994d-38d25c2b0064 req-701690bd-6306-4db6-a40c-de081e8ac3b7 service nova] Acquired lock "refresh_cache-1f86ee09-062b-428d-9870-14de77c569c0" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG nova.network.neutron [req-a2f2d50b-4829-43ca-994d-38d25c2b0064 req-701690bd-6306-4db6-a40c-de081e8ac3b7 service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Refreshing network info cache for port 58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "1f86ee09-062b-428d-9870-14de77c569c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "1f86ee09-062b-428d-9870-14de77c569c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG nova.objects.instance [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lazy-loading 'flavor' on Instance uuid 1f86ee09-062b-428d-9870-14de77c569c0 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:39:52 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Ignoring supplied device name: /dev/vdb
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "1f86ee09-062b-428d-9870-14de77c569c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "1f86ee09-062b-428d-9870-14de77c569c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "1f86ee09-062b-428d-9870-14de77c569c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:39:52 user nova-compute[75018]: INFO nova.compute.manager [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Attaching volume 8d0384bc-b22d-4541-94c2-93ee6165804b to /dev/vdb
Nov 07 15:39:52 user nova-compute[75018]: DEBUG nova.network.neutron [req-a2f2d50b-4829-43ca-994d-38d25c2b0064 req-701690bd-6306-4db6-a40c-de081e8ac3b7 service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Updated VIF entry in instance network info cache for port 58e42c23-4f3b-4394-aa4f-42ae19671af0. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG nova.network.neutron [req-a2f2d50b-4829-43ca-994d-38d25c2b0064 req-701690bd-6306-4db6-a40c-de081e8ac3b7 service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Updating instance_info_cache with network_info: [{"id": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "address": "fa:16:3e:24:bd:89", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e42c23-4f", "ovs_interfaceid": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a2f2d50b-4829-43ca-994d-38d25c2b0064 req-701690bd-6306-4db6-a40c-de081e8ac3b7 service nova] Releasing lock "refresh_cache-1f86ee09-062b-428d-9870-14de77c569c0" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG os_brick.utils [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e62b81a-2859-42da-b564-91b6400bea25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5e8acb-48e9-46a0-9db8-01c46f3bfa85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[718dc28b-3712-44d3-b8c9-fb442b18d031]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[499d4581-bc8f-4ada-b07e-383b0171df74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:39:52 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:39:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fc523d-5a47-427c-b2b2-9e9967a0c364]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG os_brick.utils [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:39:52 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Updating existing volume attachment record: e1cdc9d1-4460-4cb1-892d-71d2861c1a47 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:39:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:39:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:01 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lazy-loading 'flavor' on Instance uuid 98c33773-942b-422b-b4fd-a2b548260c09 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:40:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a418a451-6860-40d5-b10e-32e522d78aa4 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.197s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-3859c638-1e22-4cec-881c-2a7e5e91b75c req-e1f96c5b-d38f-4e7a-8908-33d6f9d3ea9f service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received event network-changed-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:09 user nova-compute[75018]: DEBUG nova.compute.manager [req-3859c638-1e22-4cec-881c-2a7e5e91b75c req-e1f96c5b-d38f-4e7a-8908-33d6f9d3ea9f service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Refreshing instance network info cache due to event network-changed-16ad0001-44b6-47a4-a689-4a7cae768eb3. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:40:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3859c638-1e22-4cec-881c-2a7e5e91b75c req-e1f96c5b-d38f-4e7a-8908-33d6f9d3ea9f service nova] Acquiring lock "refresh_cache-79aba108-cfd6-4e83-99f5-50403a500a87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:40:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3859c638-1e22-4cec-881c-2a7e5e91b75c req-e1f96c5b-d38f-4e7a-8908-33d6f9d3ea9f service nova] Acquired lock "refresh_cache-79aba108-cfd6-4e83-99f5-50403a500a87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:40:09 user nova-compute[75018]: DEBUG nova.network.neutron [req-3859c638-1e22-4cec-881c-2a7e5e91b75c req-e1f96c5b-d38f-4e7a-8908-33d6f9d3ea9f service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Refreshing network info cache for port 16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:40:09 user nova-compute[75018]: DEBUG nova.network.neutron [req-3859c638-1e22-4cec-881c-2a7e5e91b75c req-e1f96c5b-d38f-4e7a-8908-33d6f9d3ea9f service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Updated VIF entry in instance network info cache for port 16ad0001-44b6-47a4-a689-4a7cae768eb3. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:40:09 user nova-compute[75018]: DEBUG nova.network.neutron [req-3859c638-1e22-4cec-881c-2a7e5e91b75c req-e1f96c5b-d38f-4e7a-8908-33d6f9d3ea9f service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Updating instance_info_cache with network_info: [{"id": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "address": "fa:16:3e:77:f2:a5", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ad0001-44", "ovs_interfaceid": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:40:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3859c638-1e22-4cec-881c-2a7e5e91b75c req-e1f96c5b-d38f-4e7a-8908-33d6f9d3ea9f service nova] Releasing lock "refresh_cache-79aba108-cfd6-4e83-99f5-50403a500a87" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:40:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:14 user nova-compute[75018]: DEBUG nova.objects.instance [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'flavor' on Instance uuid 79aba108-cfd6-4e83-99f5-50403a500a87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:15 user nova-compute[75018]: INFO nova.compute.manager [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Attaching volume 7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff to /dev/vdb
Nov 07 15:40:15 user nova-compute[75018]: DEBUG os_brick.utils [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a3b6c1-9b1d-4ecb-9881-70c40d3c32e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[460bf9ba-a011-4aea-8079-23a017f54426]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec35b7fa-1253-4517-9455-7c3610cb95d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a974f93c-de6d-4c7c-8545-9327aed54712]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:40:15 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:40:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[018d3f53-dff9-4990-b9b0-8442ec015ddd]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG os_brick.utils [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Updating existing volume attachment record: fc326615-3bd5-437f-b370-674983a61010 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:40:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHijPFGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:40:16 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:40:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:40:16 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:40:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:40:16 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e85b327-580e-4309-ae97-7a79b02bf768]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:40:16 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e2db35-4536-4d74-9d5b-fdd0e0b06935]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b] added
Nov 07 15:40:16 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f53160d-9b0c-47bf-a91c-2c7abd30f263]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef793a5-a721-43ff-b8aa-51f9f8464ce3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YHijPFGV {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YHijPFGV" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bff545-bfda-434e-81d9-fadf3dd58a29]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YHijPFGV'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b434899b-7727-4fb7-b4c8-d280e702fc1f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1494d03-bbbc-4b50-bfcf-156d506e4310]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:40:16 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:40:16 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:40:16 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:40:16 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:40:16 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:40:16 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:40:16 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:40:16 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:40:16 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:40:16 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[08629e0c-0655-493c-8852-a451c1d8aa18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b, portal: 172.16.0.220,3260]
Nov 07 15:40:16 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b, portal: 172.16.0.220,3260] successful.
Nov 07 15:40:16 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6085219-98e3-4b69-bcca-6e709fda37e7]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6166ac6-8703-42fe-a3b5-60e0b8939141]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:40:17 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:40:17 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:40:17 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:40:17 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:40:17 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:40:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:40:17 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:40:17 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:40:17 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:40:17 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:40:17 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:40:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac77964-be74-4437-b093-d79bfc81ff86]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:40:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHijPFGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:40:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:40:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23262666237386636', 'path': '/dev/sdf'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:40:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262666237386636', 'path': '/dev/sdf'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:40:18 user nova-compute[75018]: DEBUG nova.objects.instance [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lazy-loading 'flavor' on Instance uuid 1f86ee09-062b-428d-9870-14de77c569c0 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:40:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:40:18 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:40:18 user nova-compute[75018]:   <source dev="/dev/sdf"/>
Nov 07 15:40:18 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:40:18 user nova-compute[75018]:   <serial>8d0384bc-b22d-4541-94c2-93ee6165804b</serial>
Nov 07 15:40:18 user nova-compute[75018]: </disk>
Nov 07 15:40:18 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:40:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:40:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:40:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] No VIF found with MAC fa:16:3e:24:bd:89, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:40:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-d8f50797-d67a-4d43-94ea-40f8d9dbc9be tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "1f86ee09-062b-428d-9870-14de77c569c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.664s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "98c33773-942b-422b-b4fd-a2b548260c09" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:21 user nova-compute[75018]: INFO nova.compute.manager [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Detaching volume 9cfc9935-3bd0-4df5-a4da-9ca480821b6f
Nov 07 15:40:21 user nova-compute[75018]: INFO nova.virt.block_device [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Attempting to driver detach volume 9cfc9935-3bd0-4df5-a4da-9ca480821b6f from mountpoint /dev/vdb
Nov 07 15:40:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Attempting to detach device vdb from instance 98c33773-942b-422b-b4fd-a2b548260c09 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:40:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:40:21 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:40:21 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:40:21 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:40:21 user nova-compute[75018]:   <serial>9cfc9935-3bd0-4df5-a4da-9ca480821b6f</serial>
Nov 07 15:40:21 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:40:21 user nova-compute[75018]: </disk>
Nov 07 15:40:21 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:40:21 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Successfully detached device vdb from instance 98c33773-942b-422b-b4fd-a2b548260c09 from the persistent domain config.
Nov 07 15:40:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98c33773-942b-422b-b4fd-a2b548260c09 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:40:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:40:21 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:40:21 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:40:21 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:40:21 user nova-compute[75018]:   <serial>9cfc9935-3bd0-4df5-a4da-9ca480821b6f</serial>
Nov 07 15:40:21 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:40:21 user nova-compute[75018]: </disk>
Nov 07 15:40:21 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:40:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98c33773-942b-422b-b4fd-a2b548260c09 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:40:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "7d054231-82b5-43b0-967a-78f5ef690090" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "7d054231-82b5-43b0-967a-78f5ef690090" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:28 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:40:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:28 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:40:28 user nova-compute[75018]: INFO nova.compute.claims [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Claim successful on node user
Nov 07 15:40:29 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:40:29 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:40:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG nova.policy [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57812f43f52442b78301056926451ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e104a96f426475395c2074a5f84f5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:40:29 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Creating image(s)
Nov 07 15:40:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "/opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "/opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.217s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.175s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:29 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk 1073741824" returned: 0 in 0.052s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Successfully created port: d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.211s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Cannot resize image /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Ensure instance console log exists: /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Successfully updated port: d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquired lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-31c1d5d8-5a9c-41dd-b0c3-a49c6456f30c req-a776540a-775d-4f0d-bdfb-8dd90787fc28 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Received event network-changed-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-31c1d5d8-5a9c-41dd-b0c3-a49c6456f30c req-a776540a-775d-4f0d-bdfb-8dd90787fc28 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Refreshing instance network info cache due to event network-changed-d2a12c3d-09d4-4648-8ad3-11e5e77e2837. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-31c1d5d8-5a9c-41dd-b0c3-a49c6456f30c req-a776540a-775d-4f0d-bdfb-8dd90787fc28 service nova] Acquiring lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:40:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Updating instance_info_cache with network_info: [{"id": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "address": "fa:16:3e:15:0a:74", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a12c3d-09", "ovs_interfaceid": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Releasing lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Instance network_info: |[{"id": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "address": "fa:16:3e:15:0a:74", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a12c3d-09", "ovs_interfaceid": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-31c1d5d8-5a9c-41dd-b0c3-a49c6456f30c req-a776540a-775d-4f0d-bdfb-8dd90787fc28 service nova] Acquired lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.network.neutron [req-31c1d5d8-5a9c-41dd-b0c3-a49c6456f30c req-a776540a-775d-4f0d-bdfb-8dd90787fc28 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Refreshing network info cache for port d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Start _get_guest_xml network_info=[{"id": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "address": "fa:16:3e:15:0a:74", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a12c3d-09", "ovs_interfaceid": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:40:31 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:40:31 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1903593788',display_name='tempest-TestStampPattern-server-1903593788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1903593788',id=36,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeDr8zIgWa3swsi8kRrbrY4v25ZocRcuaJSVAmNSRGFExsScPphVquqvdpzTXj7/U6FNeAF4YkECYqQe9DkYQFF9FKM0cchxIK1gDnEqMzhDHzyT8Y/sy8bS+7J/epnrg==',key_name='tempest-TestStampPattern-615359145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e104a96f426475395c2074a5f84f5c5',ramdisk_id='',reservation_id='r-2ybvdwct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-885621001',owner_user_name='tempest-TestStampPattern-885621001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:40:29Z,user_data=None,user_id='57812f43f52442b78301056926451ad2',uuid=7d054231-82b5-43b0-967a-78f5ef690090,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "address": "fa:16:3e:15:0a:74", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a12c3d-09", "ovs_interfaceid": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Converting VIF {"id": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "address": "fa:16:3e:15:0a:74", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a12c3d-09", "ovs_interfaceid": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:0a:74,bridge_name='br-int',has_traffic_filtering=True,id=d2a12c3d-09d4-4648-8ad3-11e5e77e2837,network=Network(6df5c46f-af5e-4d93-a9fa-5224b27e5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a12c3d-09') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.objects.instance [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d054231-82b5-43b0-967a-78f5ef690090 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:40:31 user nova-compute[75018]:   <uuid>7d054231-82b5-43b0-967a-78f5ef690090</uuid>
Nov 07 15:40:31 user nova-compute[75018]:   <name>instance-00000024</name>
Nov 07 15:40:31 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:40:31 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:40:31 user nova-compute[75018]:   <metadata>
Nov 07 15:40:31 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:40:31 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:40:31 user nova-compute[75018]:       <nova:name>tempest-TestStampPattern-server-1903593788</nova:name>
Nov 07 15:40:31 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:40:31</nova:creationTime>
Nov 07 15:40:31 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:40:31 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:40:31 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:40:31 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:40:31 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:40:31 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:40:31 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:40:31 user nova-compute[75018]:       <nova:owner>
Nov 07 15:40:31 user nova-compute[75018]:         <nova:user uuid="57812f43f52442b78301056926451ad2">tempest-TestStampPattern-885621001-project-member</nova:user>
Nov 07 15:40:31 user nova-compute[75018]:         <nova:project uuid="2e104a96f426475395c2074a5f84f5c5">tempest-TestStampPattern-885621001</nova:project>
Nov 07 15:40:31 user nova-compute[75018]:       </nova:owner>
Nov 07 15:40:31 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:40:31 user nova-compute[75018]:       <nova:ports>
Nov 07 15:40:31 user nova-compute[75018]:         <nova:port uuid="d2a12c3d-09d4-4648-8ad3-11e5e77e2837">
Nov 07 15:40:31 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 15:40:31 user nova-compute[75018]:         </nova:port>
Nov 07 15:40:31 user nova-compute[75018]:       </nova:ports>
Nov 07 15:40:31 user nova-compute[75018]:     </nova:instance>
Nov 07 15:40:31 user nova-compute[75018]:   </metadata>
Nov 07 15:40:31 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:40:31 user nova-compute[75018]:     <system>
Nov 07 15:40:31 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:40:31 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:40:31 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:40:31 user nova-compute[75018]:       <entry name="serial">7d054231-82b5-43b0-967a-78f5ef690090</entry>
Nov 07 15:40:31 user nova-compute[75018]:       <entry name="uuid">7d054231-82b5-43b0-967a-78f5ef690090</entry>
Nov 07 15:40:31 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:40:31 user nova-compute[75018]:     </system>
Nov 07 15:40:31 user nova-compute[75018]:   </sysinfo>
Nov 07 15:40:31 user nova-compute[75018]:   <os>
Nov 07 15:40:31 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:40:31 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:40:31 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:40:31 user nova-compute[75018]:   </os>
Nov 07 15:40:31 user nova-compute[75018]:   <features>
Nov 07 15:40:31 user nova-compute[75018]:     <acpi/>
Nov 07 15:40:31 user nova-compute[75018]:     <apic/>
Nov 07 15:40:31 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:40:31 user nova-compute[75018]:   </features>
Nov 07 15:40:31 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:40:31 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:40:31 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:40:31 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:40:31 user nova-compute[75018]:   </clock>
Nov 07 15:40:31 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:40:31 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:40:31 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:40:31 user nova-compute[75018]:   </cpu>
Nov 07 15:40:31 user nova-compute[75018]:   <devices>
Nov 07 15:40:31 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:40:31 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:40:31 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk"/>
Nov 07 15:40:31 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:40:31 user nova-compute[75018]:     </disk>
Nov 07 15:40:31 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:40:31 user nova-compute[75018]:       <mac address="fa:16:3e:15:0a:74"/>
Nov 07 15:40:31 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:40:31 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:40:31 user nova-compute[75018]:       <target dev="tapd2a12c3d-09"/>
Nov 07 15:40:31 user nova-compute[75018]:     </interface>
Nov 07 15:40:31 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:40:31 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/console.log" append="off"/>
Nov 07 15:40:31 user nova-compute[75018]:     </serial>
Nov 07 15:40:31 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:40:31 user nova-compute[75018]:     <video>
Nov 07 15:40:31 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:40:31 user nova-compute[75018]:     </video>
Nov 07 15:40:31 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:40:31 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:40:31 user nova-compute[75018]:     </rng>
Nov 07 15:40:31 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:40:31 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:40:31 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:40:31 user nova-compute[75018]:     </memballoon>
Nov 07 15:40:31 user nova-compute[75018]:   </devices>
Nov 07 15:40:31 user nova-compute[75018]: </domain>
Nov 07 15:40:31 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1903593788',display_name='tempest-TestStampPattern-server-1903593788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1903593788',id=36,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeDr8zIgWa3swsi8kRrbrY4v25ZocRcuaJSVAmNSRGFExsScPphVquqvdpzTXj7/U6FNeAF4YkECYqQe9DkYQFF9FKM0cchxIK1gDnEqMzhDHzyT8Y/sy8bS+7J/epnrg==',key_name='tempest-TestStampPattern-615359145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e104a96f426475395c2074a5f84f5c5',ramdisk_id='',reservation_id='r-2ybvdwct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-885621001',owner_user_name='tempest-TestStampPattern-885621001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:40:29Z,user_data=None,user_id='57812f43f52442b78301056926451ad2',uuid=7d054231-82b5-43b0-967a-78f5ef690090,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "address": "fa:16:3e:15:0a:74", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a12c3d-09", "ovs_interfaceid": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Converting VIF {"id": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "address": "fa:16:3e:15:0a:74", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a12c3d-09", "ovs_interfaceid": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:0a:74,bridge_name='br-int',has_traffic_filtering=True,id=d2a12c3d-09d4-4648-8ad3-11e5e77e2837,network=Network(6df5c46f-af5e-4d93-a9fa-5224b27e5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a12c3d-09') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG os_vif [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:0a:74,bridge_name='br-int',has_traffic_filtering=True,id=d2a12c3d-09d4-4648-8ad3-11e5e77e2837,network=Network(6df5c46f-af5e-4d93-a9fa-5224b27e5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a12c3d-09') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '969d7015-add7-5b14-b332-3df3ca0bc37c', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2a12c3d-09, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2a12c3d-09, col_values=(('qos', UUID('1b95ccd1-5ba6-46bc-afe8-761c4ca52e41')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2a12c3d-09, col_values=(('external_ids', {'iface-id': 'd2a12c3d-09d4-4648-8ad3-11e5e77e2837', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:0a:74', 'vm-uuid': '7d054231-82b5-43b0-967a-78f5ef690090'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:31 user nova-compute[75018]: INFO os_vif [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:0a:74,bridge_name='br-int',has_traffic_filtering=True,id=d2a12c3d-09d4-4648-8ad3-11e5e77e2837,network=Network(6df5c46f-af5e-4d93-a9fa-5224b27e5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a12c3d-09')
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] No VIF found with MAC fa:16:3e:15:0a:74, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.network.neutron [req-31c1d5d8-5a9c-41dd-b0c3-a49c6456f30c req-a776540a-775d-4f0d-bdfb-8dd90787fc28 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Updated VIF entry in instance network info cache for port d2a12c3d-09d4-4648-8ad3-11e5e77e2837. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG nova.network.neutron [req-31c1d5d8-5a9c-41dd-b0c3-a49c6456f30c req-a776540a-775d-4f0d-bdfb-8dd90787fc28 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Updating instance_info_cache with network_info: [{"id": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "address": "fa:16:3e:15:0a:74", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a12c3d-09", "ovs_interfaceid": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:40:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-31c1d5d8-5a9c-41dd-b0c3-a49c6456f30c req-a776540a-775d-4f0d-bdfb-8dd90787fc28 service nova] Releasing lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:40:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-d0ba0d3a-fb5f-4ec3-afe8-b7a26ffe5795 req-f6b7af4b-708e-41e6-a84b-b9a0bb0b39f5 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Received event network-vif-plugged-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d0ba0d3a-fb5f-4ec3-afe8-b7a26ffe5795 req-f6b7af4b-708e-41e6-a84b-b9a0bb0b39f5 service nova] Acquiring lock "7d054231-82b5-43b0-967a-78f5ef690090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d0ba0d3a-fb5f-4ec3-afe8-b7a26ffe5795 req-f6b7af4b-708e-41e6-a84b-b9a0bb0b39f5 service nova] Lock "7d054231-82b5-43b0-967a-78f5ef690090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d0ba0d3a-fb5f-4ec3-afe8-b7a26ffe5795 req-f6b7af4b-708e-41e6-a84b-b9a0bb0b39f5 service nova] Lock "7d054231-82b5-43b0-967a-78f5ef690090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-d0ba0d3a-fb5f-4ec3-afe8-b7a26ffe5795 req-f6b7af4b-708e-41e6-a84b-b9a0bb0b39f5 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] No waiting events found dispatching network-vif-plugged-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:40:33 user nova-compute[75018]: WARNING nova.compute.manager [req-d0ba0d3a-fb5f-4ec3-afe8-b7a26ffe5795 req-f6b7af4b-708e-41e6-a84b-b9a0bb0b39f5 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Received unexpected event network-vif-plugged-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 for instance with vm_state building and task_state spawning.
Nov 07 15:40:33 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:40:33 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:40:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-de9fce24-bed0-4e74-9f8c-2102178113c3 req-84b0f55f-0eb3-44a4-8f7f-c2f2c6f48a5d service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Received event network-vif-plugged-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-de9fce24-bed0-4e74-9f8c-2102178113c3 req-84b0f55f-0eb3-44a4-8f7f-c2f2c6f48a5d service nova] Acquiring lock "7d054231-82b5-43b0-967a-78f5ef690090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-de9fce24-bed0-4e74-9f8c-2102178113c3 req-84b0f55f-0eb3-44a4-8f7f-c2f2c6f48a5d service nova] Lock "7d054231-82b5-43b0-967a-78f5ef690090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-de9fce24-bed0-4e74-9f8c-2102178113c3 req-84b0f55f-0eb3-44a4-8f7f-c2f2c6f48a5d service nova] Lock "7d054231-82b5-43b0-967a-78f5ef690090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-de9fce24-bed0-4e74-9f8c-2102178113c3 req-84b0f55f-0eb3-44a4-8f7f-c2f2c6f48a5d service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] No waiting events found dispatching network-vif-plugged-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:40:35 user nova-compute[75018]: WARNING nova.compute.manager [req-de9fce24-bed0-4e74-9f8c-2102178113c3 req-84b0f55f-0eb3-44a4-8f7f-c2f2c6f48a5d service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Received unexpected event network-vif-plugged-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 for instance with vm_state building and task_state spawning.
Nov 07 15:40:35 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:40:35 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:40:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:40:35 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Instance spawned successfully.
Nov 07 15:40:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:40:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:40:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:40:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:40:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:40:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:40:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:40:35 user nova-compute[75018]: INFO nova.compute.manager [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 07 15:40:35 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:40:35 user nova-compute[75018]: INFO nova.compute.manager [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Took 7.27 seconds to build instance.
Nov 07 15:40:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b5821837-54d8-40f7-87c8-8e29836424c0 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "7d054231-82b5-43b0-967a-78f5ef690090" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.413s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:40:37 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:40:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-31e90a00-c2df-493c-9b7e-12d3063b877f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:40:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-31e90a00-c2df-493c-9b7e-12d3063b877f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:40:37 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:40:38 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Updating instance_info_cache with network_info: [{"id": "c8446401-eb10-4144-8266-999410a90896", "address": "fa:16:3e:d6:25:ef", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8446401-eb", "ovs_interfaceid": "c8446401-eb10-4144-8266-999410a90896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:40:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-31e90a00-c2df-493c-9b7e-12d3063b877f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:40:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:40:39 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:40:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:39 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:40:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:40:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:40:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:40:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:40:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:40:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 98c33773-942b-422b-b4fd-a2b548260c09 is timed out.
Nov 07 15:40:42 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Successfully detached device vdb from instance 98c33773-942b-422b-b4fd-a2b548260c09 from the live domain config.
Nov 07 15:40:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRgHLcFO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:40:42 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3506ed0-b82a-421e-9e80-2d037b6ce736]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:40:42 user nova-compute[75018]: No targets found.
Nov 07 15:40:42 user nova-compute[75018]: iSNS:
Nov 07 15:40:42 user nova-compute[75018]: No targets found.
Nov 07 15:40:42 user nova-compute[75018]: STATIC:
Nov 07 15:40:42 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444
Nov 07 15:40:42 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:42 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:42 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee
Nov 07 15:40:42 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:42 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:42 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96
Nov 07 15:40:42 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:42 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:42 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823
Nov 07 15:40:42 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:42 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:42 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b
Nov 07 15:40:42 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:42 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:42 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f
Nov 07 15:40:42 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:42 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:42 user nova-compute[75018]: FIRMWARE:
Nov 07 15:40:42 user nova-compute[75018]: No targets found.
Nov 07 15:40:42 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:40:42 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:40:42 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf12df0-cd6c-49c6-8427-f9d58ae3f4ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a200de12-a419-4944-870d-3e7766a27486]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:40:42 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:40:42 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feaf82e76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f'): ({'sdd'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Removing single pathed devices sdd {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7172a0f6-baef-4174-839a-0c6138e1fe66]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e057573b-a787-4113-84c9-b3763da7a502]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Flushing IO for device /dev/sdd {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb323c8-434b-4604-a30c-bf849017c5ce]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ca1cc0-209d-4b16-9b10-46ad63759b44]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[03809c13-0e23-4fea-bd9a-4fa33b59320e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nBkzxSeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:40:42 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a012c55c-ca75-45a7-861e-c886168ca028]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f, portal: 172.16.0.220,3260]
Nov 07 15:40:42 user nova-compute[75018]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f, portal: 172.16.0.220,3260] successful.
Nov 07 15:40:42 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfc9935-3bd0-4df5-a4da-9ca480821b6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04885d9-f7ed-4900-8f0e-662a464917ed]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] <== disconnect_volume: return (400ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.084s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:40:42 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:40:42 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[17274dae-5774-4653-9b1b-6303fcb3ffd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:40:42 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf46cfec-ead3-4f39-90e5-cb7fef2c6f67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff] added
Nov 07 15:40:42 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9379d726-6a63-4983-97ef-2fd462b977e4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b708faf-61cd-4a3d-bf23-56297e988630]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nBkzxSeQ {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nBkzxSeQ" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0457e7-f0aa-4264-b099-9ca2bbd4904c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nBkzxSeQ'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41c1672-a171-424c-93ac-6744a9e2bcbc]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[17074d0f-d877-4b74-87f0-ec1647986a1b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:40:42 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:40:42 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a160c75-65d7-4bd6-8d37-b9859fb97424]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff, portal: 172.16.0.220,3260]
Nov 07 15:40:42 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff, portal: 172.16.0.220,3260] successful.
Nov 07 15:40:42 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d355d90-31de-42d5-8866-10eb25e9656a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0176a7-4161-4c07-8e3f-3d3beb6ab095]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:40:42 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:40:42 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:40:42 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d845ffb-357e-4293-ad6c-3212b6060a88]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG nova.objects.instance [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lazy-loading 'flavor' on Instance uuid 98c33773-942b-422b-b4fd-a2b548260c09 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-042184bf-1b92-426d-accb-0e0b894b5ff0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.107s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nBkzxSeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] <== connect_volume: return (1519ms) {'type': 'block', 'scsi_wwn': '23261306334353766', 'path': '/dev/sdd'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261306334353766', 'path': '/dev/sdd'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG nova.objects.instance [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'flavor' on Instance uuid 79aba108-cfd6-4e83-99f5-50403a500a87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:40:43 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:40:43 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:40:43 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:40:43 user nova-compute[75018]:   <serial>7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff</serial>
Nov 07 15:40:43 user nova-compute[75018]: </disk>
Nov 07 15:40:43 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:44 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:40:44 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7325MB free_disk=25.033477783203125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] No VIF found with MAC fa:16:3e:77:f2:a5, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 31e90a00-c2df-493c-9b7e-12d3063b877f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e4ad018d-bdc7-458b-9e77-ba31457e52ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 98c33773-942b-422b-b4fd-a2b548260c09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 4bf14e55-beb3-4800-8472-3436fa21b45e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1f86ee09-062b-428d-9870-14de77c569c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 79aba108-cfd6-4e83-99f5-50403a500a87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 16453b1b-908e-4e7e-8596-7fc4211d5cea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 7d054231-82b5-43b0-967a-78f5ef690090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:40:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f98dbf48-7d60-426e-9153-37ae18bfaec1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.727s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:45 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:40:45 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:40:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:40:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:46 user nova-compute[75018]: INFO nova.compute.manager [None req-979c5838-9858-4679-8edc-b2f222c61669 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Unrescuing
Nov 07 15:40:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-979c5838-9858-4679-8edc-b2f222c61669 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:40:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-979c5838-9858-4679-8edc-b2f222c61669 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquired lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:40:46 user nova-compute[75018]: DEBUG nova.network.neutron [None req-979c5838-9858-4679-8edc-b2f222c61669 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:40:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:40:46 user nova-compute[75018]: DEBUG nova.network.neutron [None req-979c5838-9858-4679-8edc-b2f222c61669 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updating instance_info_cache with network_info: [{"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:40:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-979c5838-9858-4679-8edc-b2f222c61669 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Releasing lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:40:46 user nova-compute[75018]: DEBUG nova.objects.instance [None req-979c5838-9858-4679-8edc-b2f222c61669 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'flavor' on Instance uuid e4ad018d-bdc7-458b-9e77-ba31457e52ff {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:40:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-d4391f70-c448-485f-af32-d98c88ae078a req-9962b20a-9ce8-48b4-aaf6-e2e3e5e3185e service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-vif-unplugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d4391f70-c448-485f-af32-d98c88ae078a req-9962b20a-9ce8-48b4-aaf6-e2e3e5e3185e service nova] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d4391f70-c448-485f-af32-d98c88ae078a req-9962b20a-9ce8-48b4-aaf6-e2e3e5e3185e service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d4391f70-c448-485f-af32-d98c88ae078a req-9962b20a-9ce8-48b4-aaf6-e2e3e5e3185e service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-d4391f70-c448-485f-af32-d98c88ae078a req-9962b20a-9ce8-48b4-aaf6-e2e3e5e3185e service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] No waiting events found dispatching network-vif-unplugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:40:47 user nova-compute[75018]: WARNING nova.compute.manager [req-d4391f70-c448-485f-af32-d98c88ae078a req-9962b20a-9ce8-48b4-aaf6-e2e3e5e3185e service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received unexpected event network-vif-unplugged-280fe9e4-a375-4c55-adf5-babbe012ef3b for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:40:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:40:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:40:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:40:47 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Instance destroyed successfully.
Nov 07 15:40:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-d43cdd69-6b15-46c7-898c-bd95051adbb0 req-84d888ef-3702-434b-8fd3-38047d9bf15e service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Received event network-changed-6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-d43cdd69-6b15-46c7-898c-bd95051adbb0 req-84d888ef-3702-434b-8fd3-38047d9bf15e service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Refreshing instance network info cache due to event network-changed-6c145764-6875-4749-910d-69dff1c5f6cb. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:40:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d43cdd69-6b15-46c7-898c-bd95051adbb0 req-84d888ef-3702-434b-8fd3-38047d9bf15e service nova] Acquiring lock "refresh_cache-16453b1b-908e-4e7e-8596-7fc4211d5cea" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:40:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d43cdd69-6b15-46c7-898c-bd95051adbb0 req-84d888ef-3702-434b-8fd3-38047d9bf15e service nova] Acquired lock "refresh_cache-16453b1b-908e-4e7e-8596-7fc4211d5cea" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:40:48 user nova-compute[75018]: DEBUG nova.network.neutron [req-d43cdd69-6b15-46c7-898c-bd95051adbb0 req-84d888ef-3702-434b-8fd3-38047d9bf15e service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Refreshing network info cache for port 6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:40:48 user nova-compute[75018]: DEBUG nova.network.neutron [req-d43cdd69-6b15-46c7-898c-bd95051adbb0 req-84d888ef-3702-434b-8fd3-38047d9bf15e service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Updated VIF entry in instance network info cache for port 6c145764-6875-4749-910d-69dff1c5f6cb. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:40:48 user nova-compute[75018]: DEBUG nova.network.neutron [req-d43cdd69-6b15-46c7-898c-bd95051adbb0 req-84d888ef-3702-434b-8fd3-38047d9bf15e service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Updating instance_info_cache with network_info: [{"id": "6c145764-6875-4749-910d-69dff1c5f6cb", "address": "fa:16:3e:9c:0d:6e", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c145764-68", "ovs_interfaceid": "6c145764-6875-4749-910d-69dff1c5f6cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:40:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d43cdd69-6b15-46c7-898c-bd95051adbb0 req-84d888ef-3702-434b-8fd3-38047d9bf15e service nova] Releasing lock "refresh_cache-16453b1b-908e-4e7e-8596-7fc4211d5cea" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-f258f187-4fbb-4a52-b8af-af0a2eb93bb7 req-d8651dc3-f0c9-4b20-a06c-62b9190a3dff service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f258f187-4fbb-4a52-b8af-af0a2eb93bb7 req-d8651dc3-f0c9-4b20-a06c-62b9190a3dff service nova] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f258f187-4fbb-4a52-b8af-af0a2eb93bb7 req-d8651dc3-f0c9-4b20-a06c-62b9190a3dff service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f258f187-4fbb-4a52-b8af-af0a2eb93bb7 req-d8651dc3-f0c9-4b20-a06c-62b9190a3dff service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-f258f187-4fbb-4a52-b8af-af0a2eb93bb7 req-d8651dc3-f0c9-4b20-a06c-62b9190a3dff service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] No waiting events found dispatching network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:40:49 user nova-compute[75018]: WARNING nova.compute.manager [req-f258f187-4fbb-4a52-b8af-af0a2eb93bb7 req-d8651dc3-f0c9-4b20-a06c-62b9190a3dff service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received unexpected event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:40:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "16453b1b-908e-4e7e-8596-7fc4211d5cea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "16453b1b-908e-4e7e-8596-7fc4211d5cea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:49 user nova-compute[75018]: INFO nova.compute.manager [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Terminating instance
Nov 07 15:40:49 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Instance destroyed successfully.
Nov 07 15:40:50 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lazy-loading 'resources' on Instance uuid 16453b1b-908e-4e7e-8596-7fc4211d5cea {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1228903760',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1228903760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1228903760',id=34,image_ref='50ed591c-a29e-4dca-ace0-8644fa67b0b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRH6KYnrTQrrfnmKgoscAyw0xHucdagkv5LPvRqwtQUpnijSJQsr7GSFT6wBQ3lB2p613P3iY/a7lSnYFW+g8+wQrLx+3j+q88dzf+xKuOCOPxdPjJEhL7DtNtXXUMEAA==',key_name='tempest-keypair-1580684035',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='772e759d9a1d4d18ae43f53c731f87f2',ramdisk_id='',reservation_id='r-ryi8yqjt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1644595019',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1644595019',owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ae23950e1e84c9693f8098c270ecb55',uuid=16453b1b-908e-4e7e-8596-7fc4211d5cea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c145764-6875-4749-910d-69dff1c5f6cb", "address": "fa:16:3e:9c:0d:6e", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c145764-68", "ovs_interfaceid": "6c145764-6875-4749-910d-69dff1c5f6cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converting VIF {"id": "6c145764-6875-4749-910d-69dff1c5f6cb", "address": "fa:16:3e:9c:0d:6e", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c145764-68", "ovs_interfaceid": "6c145764-6875-4749-910d-69dff1c5f6cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:0d:6e,bridge_name='br-int',has_traffic_filtering=True,id=6c145764-6875-4749-910d-69dff1c5f6cb,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c145764-68') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_vif [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:0d:6e,bridge_name='br-int',has_traffic_filtering=True,id=6c145764-6875-4749-910d-69dff1c5f6cb,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c145764-68') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c145764-68, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49876aa3-7899-4c18-9ba4-1bc31b26d464) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:50 user nova-compute[75018]: INFO os_vif [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:0d:6e,bridge_name='br-int',has_traffic_filtering=True,id=6c145764-6875-4749-910d-69dff1c5f6cb,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c145764-68')
Nov 07 15:40:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdTPluro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:40:50 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[990fa836-ef33-4269-b42b-1c5d19437725]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:40:50 user nova-compute[75018]: No targets found.
Nov 07 15:40:50 user nova-compute[75018]: iSNS:
Nov 07 15:40:50 user nova-compute[75018]: No targets found.
Nov 07 15:40:50 user nova-compute[75018]: STATIC:
Nov 07 15:40:50 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444
Nov 07 15:40:50 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:50 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:50 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee
Nov 07 15:40:50 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:50 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:50 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96
Nov 07 15:40:50 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:50 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:50 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823
Nov 07 15:40:50 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:50 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:50 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff
Nov 07 15:40:50 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:50 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:50 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b
Nov 07 15:40:50 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:50 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:50 user nova-compute[75018]: FIRMWARE:
Nov 07 15:40:50 user nova-compute[75018]: No targets found.
Nov 07 15:40:50 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:40:50 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:40:50 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8ce17e-d9fd-4263-abee-005a0977e60c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54588e2-4f60-475a-871f-5e5f696c5fce]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:40:50 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:40:50 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:40:50 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:40:50 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:40:50 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:40:50 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:40:50 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:40:50 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:40:50 user nova-compute[75018]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 (non-flash)
Nov 07 15:40:50 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:40:50 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:40:50 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feaf823be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96'): ({'sdg'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Removing single pathed devices sdg {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1227fc-0d85-4ad6-b9d6-bd6ed417fbeb]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5a5bec-4b46-4af2-830d-adb4176cf742]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Flushing IO for device /dev/sdg {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1949b740-f581-45c1-bb8e-020b86145e35]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-ac965b82-a8f7-4fea-8ec5-e2257900737c req-7eb57ad0-d24c-4fec-b11a-0ab827f8b6f4 service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Received event network-vif-unplugged-6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ac965b82-a8f7-4fea-8ec5-e2257900737c req-7eb57ad0-d24c-4fec-b11a-0ab827f8b6f4 service nova] Acquiring lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ac965b82-a8f7-4fea-8ec5-e2257900737c req-7eb57ad0-d24c-4fec-b11a-0ab827f8b6f4 service nova] Lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ac965b82-a8f7-4fea-8ec5-e2257900737c req-7eb57ad0-d24c-4fec-b11a-0ab827f8b6f4 service nova] Lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-ac965b82-a8f7-4fea-8ec5-e2257900737c req-7eb57ad0-d24c-4fec-b11a-0ab827f8b6f4 service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] No waiting events found dispatching network-vif-unplugged-6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-ac965b82-a8f7-4fea-8ec5-e2257900737c req-7eb57ad0-d24c-4fec-b11a-0ab827f8b6f4 service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Received event network-vif-unplugged-6c145764-6875-4749-910d-69dff1c5f6cb for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2578c36-00e1-4d01-a5e4-768030156aa2]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] SCSI volumes sdg have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5b9a92ca', '/dev/disk/by-id/scsi-1SCST_BIO5b9a92ca-e04df9c41c9eedfb', '/dev/disk/by-id/scsi-26530346466396334') {{(pid=86127) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae525ced-bd14-4ced-a28b-637b3118de91]: (4, None) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0152e22-428f-4482-b766-3c2c2304571f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4822cf66-dde7-41b6-9b8a-271fb911f886]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96, portal: 172.16.0.220,3260]
Nov 07 15:40:50 user nova-compute[75018]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96, portal: 172.16.0.220,3260] successful.
Nov 07 15:40:50 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb54521f-56ea-436c-b762-cac0c6738c96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dfd911-6786-421d-8775-f4bf7f251aa1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.488s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] <== disconnect_volume: return (489ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:40:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Deleting instance files /opt/stack/data/nova/instances/16453b1b-908e-4e7e-8596-7fc4211d5cea_del
Nov 07 15:40:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Deletion of /opt/stack/data/nova/instances/16453b1b-908e-4e7e-8596-7fc4211d5cea_del complete
Nov 07 15:40:50 user nova-compute[75018]: INFO nova.compute.manager [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Took 1.59 seconds to destroy the instance on the hypervisor.
Nov 07 15:40:50 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:40:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-379d58e9-7d37-4592-af2a-575b8e276944 req-a0e2eb4b-986f-4300-b2bc-f7e5a702e5ee service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-379d58e9-7d37-4592-af2a-575b8e276944 req-a0e2eb4b-986f-4300-b2bc-f7e5a702e5ee service nova] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-379d58e9-7d37-4592-af2a-575b8e276944 req-a0e2eb4b-986f-4300-b2bc-f7e5a702e5ee service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-379d58e9-7d37-4592-af2a-575b8e276944 req-a0e2eb4b-986f-4300-b2bc-f7e5a702e5ee service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-379d58e9-7d37-4592-af2a-575b8e276944 req-a0e2eb4b-986f-4300-b2bc-f7e5a702e5ee service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] No waiting events found dispatching network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:40:51 user nova-compute[75018]: WARNING nova.compute.manager [req-379d58e9-7d37-4592-af2a-575b8e276944 req-a0e2eb4b-986f-4300-b2bc-f7e5a702e5ee service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received unexpected event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:40:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-379d58e9-7d37-4592-af2a-575b8e276944 req-a0e2eb4b-986f-4300-b2bc-f7e5a702e5ee service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-379d58e9-7d37-4592-af2a-575b8e276944 req-a0e2eb4b-986f-4300-b2bc-f7e5a702e5ee service nova] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-379d58e9-7d37-4592-af2a-575b8e276944 req-a0e2eb4b-986f-4300-b2bc-f7e5a702e5ee service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-379d58e9-7d37-4592-af2a-575b8e276944 req-a0e2eb4b-986f-4300-b2bc-f7e5a702e5ee service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-379d58e9-7d37-4592-af2a-575b8e276944 req-a0e2eb4b-986f-4300-b2bc-f7e5a702e5ee service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] No waiting events found dispatching network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:40:51 user nova-compute[75018]: WARNING nova.compute.manager [req-379d58e9-7d37-4592-af2a-575b8e276944 req-a0e2eb4b-986f-4300-b2bc-f7e5a702e5ee service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received unexpected event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:40:52 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:40:52 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Took 1.20 seconds to deallocate network for instance.
Nov 07 15:40:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-979c5838-9858-4679-8edc-b2f222c61669 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:40:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Received event network-vif-plugged-6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] Acquiring lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] Lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] Lock "16453b1b-908e-4e7e-8596-7fc4211d5cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] No waiting events found dispatching network-vif-plugged-6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:40:52 user nova-compute[75018]: WARNING nova.compute.manager [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Received unexpected event network-vif-plugged-6c145764-6875-4749-910d-69dff1c5f6cb for instance with vm_state active and task_state deleting.
Nov 07 15:40:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Received event network-changed-88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Refreshing instance network info cache due to event network-changed-88ce52b1-c8b7-4958-ad77-4424811b13b6. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:40:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] Acquiring lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:40:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] Acquired lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:40:52 user nova-compute[75018]: DEBUG nova.network.neutron [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Refreshing network info cache for port 88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:40:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:52 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'flavor' on Instance uuid 79aba108-cfd6-4e83-99f5-50403a500a87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:40:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:53 user nova-compute[75018]: INFO nova.compute.manager [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Attaching volume 3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce to /dev/vdc
Nov 07 15:40:53 user nova-compute[75018]: DEBUG os_brick.utils [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cb40b4-ffb3-4281-ab7d-d2fcbc80397a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa491d9-0f05-487d-8a0d-c0012048875a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e445b88-1cd6-4b75-bace-2562fd9f6876]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed24bd0-7c69-4d17-8a23-0b3f494d6dcd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:40:53 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57e986f-03e5-409e-8678-0dd57e9a28f5]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG os_brick.utils [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Updating existing volume attachment record: fbf2f385-4e60-4cd3-8dfe-3ad57958411d {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG nova.network.neutron [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updated VIF entry in instance network info cache for port 88ce52b1-c8b7-4958-ad77-4424811b13b6. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG nova.network.neutron [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updating instance_info_cache with network_info: [{"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] Releasing lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received event network-changed-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Refreshing instance network info cache due to event network-changed-83dd20e9-5978-4447-b595-18937fab35d5. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] Acquiring lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] Acquired lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:40:53 user nova-compute[75018]: DEBUG nova.network.neutron [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Refreshing network info cache for port 83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:40:54 user nova-compute[75018]: DEBUG nova.network.neutron [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Updated VIF entry in instance network info cache for port 83dd20e9-5978-4447-b595-18937fab35d5. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:40:54 user nova-compute[75018]: DEBUG nova.network.neutron [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Updating instance_info_cache with network_info: [{"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:40:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] Releasing lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:40:54 user nova-compute[75018]: DEBUG nova.compute.manager [req-967c4a2f-8871-4b95-92cb-8114adb9dd41 req-6eee599a-1256-4817-9bfd-5820ba54d30d service nova] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Received event network-vif-deleted-6c145764-6875-4749-910d-69dff1c5f6cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:54 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Stashing vm_state: active {{(pid=75018) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 07 15:40:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:54 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:40:54 user nova-compute[75018]: INFO nova.compute.claims [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Claim successful on node user
Nov 07 15:40:54 user nova-compute[75018]: INFO nova.compute.resource_tracker [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Updating resource usage from migration 186d34d9-58f3-462a-9aff-bb7fb3631d98
Nov 07 15:40:55 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:40:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:55 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:40:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.629s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:55 user nova-compute[75018]: INFO nova.compute.manager [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Migrating
Nov 07 15:40:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:40:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquired lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:40:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:40:56 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Updating instance_info_cache with network_info: [{"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:40:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Releasing lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:40:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Starting migrate_disk_and_power_off {{(pid=75018) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 07 15:40:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:56 user nova-compute[75018]: DEBUG nova.compute.manager [req-918f3abf-6ea6-4382-88c0-e106a50b3cb1 req-e2b754b4-fcff-4d3c-9f6c-c6f2be540fa2 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received event network-vif-unplugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-918f3abf-6ea6-4382-88c0-e106a50b3cb1 req-e2b754b4-fcff-4d3c-9f6c-c6f2be540fa2 service nova] Acquiring lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-918f3abf-6ea6-4382-88c0-e106a50b3cb1 req-e2b754b4-fcff-4d3c-9f6c-c6f2be540fa2 service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-918f3abf-6ea6-4382-88c0-e106a50b3cb1 req-e2b754b4-fcff-4d3c-9f6c-c6f2be540fa2 service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:56 user nova-compute[75018]: DEBUG nova.compute.manager [req-918f3abf-6ea6-4382-88c0-e106a50b3cb1 req-e2b754b4-fcff-4d3c-9f6c-c6f2be540fa2 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] No waiting events found dispatching network-vif-unplugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:40:56 user nova-compute[75018]: WARNING nova.compute.manager [req-918f3abf-6ea6-4382-88c0-e106a50b3cb1 req-e2b754b4-fcff-4d3c-9f6c-c6f2be540fa2 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received unexpected event network-vif-unplugged-83dd20e9-5978-4447-b595-18937fab35d5 for instance with vm_state active and task_state resize_migrating.
Nov 07 15:40:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:57 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Instance destroyed successfully.
Nov 07 15:40:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-68415212',display_name='tempest-ServerActionsTestOtherA-server-68415212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-68415212',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWUuR4eTrthHIodCYA4J9kJfg+RXJSyXAWybmq/Ac2FttoM8S/nLdDec5RLFtfiG+hcM5DvHo1f+xa7mxv4L56s6Q3dpUvRcBzbdTOGBBvgSiAYU0HY5RSxW2+5w/RcXA==',key_name='tempest-keypair-2049594144',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:39:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-xtwasur4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:40:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-259037608-network", "vif_mac": "fa:16:3e:a4:c0:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-259037608-network", "vif_mac": "fa:16:3e:a4:c0:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=83dd20e9-5978-4447-b595-18937fab35d5,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dd20e9-59') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_vif [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=83dd20e9-5978-4447-b595-18937fab35d5,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dd20e9-59') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83dd20e9-59, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b41ac417-3400-40a3-9bdc-f244d6215b81) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:57 user nova-compute[75018]: INFO os_vif [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=83dd20e9-5978-4447-b595-18937fab35d5,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dd20e9-59')
Nov 07 15:40:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxOItsEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:40:57 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7012d83b-5273-4e44-92ee-81e2bee881da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:40:57 user nova-compute[75018]: No targets found.
Nov 07 15:40:57 user nova-compute[75018]: iSNS:
Nov 07 15:40:57 user nova-compute[75018]: No targets found.
Nov 07 15:40:57 user nova-compute[75018]: STATIC:
Nov 07 15:40:57 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444
Nov 07 15:40:57 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:57 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:57 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee
Nov 07 15:40:57 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:57 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:57 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823
Nov 07 15:40:57 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:57 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:57 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff
Nov 07 15:40:57 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:57 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:57 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b
Nov 07 15:40:57 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:40:57 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:40:57 user nova-compute[75018]: FIRMWARE:
Nov 07 15:40:57 user nova-compute[75018]: No targets found.
Nov 07 15:40:57 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:40:57 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:40:57 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bae4ee8-17f1-4982-8c81-89c6426f00d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa04a1a6-10bc-48f7-9cf5-90f0abebb916]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:40:57 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:40:57 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:40:57 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:40:57 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:40:57 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:40:57 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:40:57 user nova-compute[75018]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:40:57 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:40:57 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:40:57 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb00338820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee'): ({'sde'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Removing single pathed devices sde {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6879e38e-8f70-467f-bf04-7e7ee8061607]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae1b53c-7636-4b77-b9e8-965b00b59e6d]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Flushing IO for device /dev/sde {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[31017cf5-1174-418f-9926-58995bdc0ada]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[153a6413-4e10-45e2-9476-ae34e6049f1b]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] SCSI volumes sde have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[795bb34e-61c8-4141-9be0-330331dce747]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b181ff5-6102-40f6-a228-af7c9de794fc]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260]
Nov 07 15:40:57 user nova-compute[75018]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260] successful.
Nov 07 15:40:57 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc73495d-55ad-44ee-a2f8-b102b5724724]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] <== disconnect_volume: return (475ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:40:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:40:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-105720c8-f334-4903-a4a3-7534cf2a0e54 req-acfcb8c8-d520-4f38-bea1-07a90ab3bf22 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received event network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-105720c8-f334-4903-a4a3-7534cf2a0e54 req-acfcb8c8-d520-4f38-bea1-07a90ab3bf22 service nova] Acquiring lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-105720c8-f334-4903-a4a3-7534cf2a0e54 req-acfcb8c8-d520-4f38-bea1-07a90ab3bf22 service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-105720c8-f334-4903-a4a3-7534cf2a0e54 req-acfcb8c8-d520-4f38-bea1-07a90ab3bf22 service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-105720c8-f334-4903-a4a3-7534cf2a0e54 req-acfcb8c8-d520-4f38-bea1-07a90ab3bf22 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] No waiting events found dispatching network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:40:59 user nova-compute[75018]: WARNING nova.compute.manager [req-105720c8-f334-4903-a4a3-7534cf2a0e54 req-acfcb8c8-d520-4f38-bea1-07a90ab3bf22 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received unexpected event network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 for instance with vm_state active and task_state resize_migrating.
Nov 07 15:40:59 user nova-compute[75018]: INFO nova.compute.manager [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Took 6.94 seconds to detach 1 volumes for instance.
Nov 07 15:40:59 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 16453b1b-908e-4e7e-8596-7fc4211d5cea] Deleting volume: fb54521f-56ea-436c-b762-cac0c6738c96 {{(pid=75018) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Port 83dd20e9-5978-4447-b595-18937fab35d5 binding to destination host user is already ACTIVE {{(pid=75018) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "31e90a00-c2df-493c-9b7e-12d3063b877f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:59 user nova-compute[75018]: INFO nova.compute.manager [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Terminating instance
Nov 07 15:40:59 user nova-compute[75018]: DEBUG nova.compute.manager [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquired lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:40:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.556s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:40:59 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Deleted allocations for instance 16453b1b-908e-4e7e-8596-7fc4211d5cea
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a1e03ea5-5e81-4584-9cdc-08053e9ef904 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "16453b1b-908e-4e7e-8596-7fc4211d5cea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.698s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-65fe0cf4-bf9b-4889-8f9e-9fffc9a20736 req-b4969a53-ca64-4347-aedb-21643bbfc759 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Received event network-vif-unplugged-c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-65fe0cf4-bf9b-4889-8f9e-9fffc9a20736 req-b4969a53-ca64-4347-aedb-21643bbfc759 service nova] Acquiring lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-65fe0cf4-bf9b-4889-8f9e-9fffc9a20736 req-b4969a53-ca64-4347-aedb-21643bbfc759 service nova] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-65fe0cf4-bf9b-4889-8f9e-9fffc9a20736 req-b4969a53-ca64-4347-aedb-21643bbfc759 service nova] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-65fe0cf4-bf9b-4889-8f9e-9fffc9a20736 req-b4969a53-ca64-4347-aedb-21643bbfc759 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] No waiting events found dispatching network-vif-unplugged-c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-65fe0cf4-bf9b-4889-8f9e-9fffc9a20736 req-b4969a53-ca64-4347-aedb-21643bbfc759 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Received event network-vif-unplugged-c8446401-eb10-4144-8266-999410a90896 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:00 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Instance destroyed successfully.
Nov 07 15:41:00 user nova-compute[75018]: DEBUG nova.objects.instance [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lazy-loading 'resources' on Instance uuid 31e90a00-c2df-493c-9b7e-12d3063b877f {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-284257270',display_name='tempest-ServersNegativeTestJSON-server-284257270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-284257270',id=22,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:31:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aba46e41b23a4c1b93fa1e8b03715ba8',ramdisk_id='',reservation_id='r-g4jf18ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1403438128',owner_user_name='tempest-ServersNegativeTestJSON-1403438128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:31:55Z,user_data=None,user_id='6096aee5520e4cc4a9f34fdef6bae6da',uuid=31e90a00-c2df-493c-9b7e-12d3063b877f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8446401-eb10-4144-8266-999410a90896", "address": "fa:16:3e:d6:25:ef", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8446401-eb", "ovs_interfaceid": "c8446401-eb10-4144-8266-999410a90896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Converting VIF {"id": "c8446401-eb10-4144-8266-999410a90896", "address": "fa:16:3e:d6:25:ef", "network": {"id": "4360a01c-f5c5-4d5f-86f0-0ace428bfe0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902782763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aba46e41b23a4c1b93fa1e8b03715ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8446401-eb", "ovs_interfaceid": "c8446401-eb10-4144-8266-999410a90896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:25:ef,bridge_name='br-int',has_traffic_filtering=True,id=c8446401-eb10-4144-8266-999410a90896,network=Network(4360a01c-f5c5-4d5f-86f0-0ace428bfe0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8446401-eb') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG os_vif [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:25:ef,bridge_name='br-int',has_traffic_filtering=True,id=c8446401-eb10-4144-8266-999410a90896,network=Network(4360a01c-f5c5-4d5f-86f0-0ace428bfe0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8446401-eb') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8446401-eb, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cac80d97-f0fa-4f34-a8d3-7516692608c0) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:00 user nova-compute[75018]: INFO os_vif [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:25:ef,bridge_name='br-int',has_traffic_filtering=True,id=c8446401-eb10-4144-8266-999410a90896,network=Network(4360a01c-f5c5-4d5f-86f0-0ace428bfe0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8446401-eb')
Nov 07 15:41:00 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Deleting instance files /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f_del
Nov 07 15:41:00 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Deletion of /opt/stack/data/nova/instances/31e90a00-c2df-493c-9b7e-12d3063b877f_del complete
Nov 07 15:41:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:00 user nova-compute[75018]: INFO nova.compute.manager [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG nova.network.neutron [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Updating instance_info_cache with network_info: [{"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Releasing lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG os_brick.utils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc85717-b5b2-475d-a452-10a04726c511]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ab07f6-6ed9-436b-913c-ca680bcae476]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2640adb9-26eb-4c8c-ad4d-6f5aadff2d1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b87c21c-22aa-417e-9275-8be1943af8c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:41:00 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:41:00 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4b3d2c-c48e-4ea1-9c1c-1017466b64e4]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG os_brick.utils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:01 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:41:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-d6e7732e-85e4-4f61-be20-8f8e1a977698 req-d54009ad-09f2-4207-a46a-c171113b89a9 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Received event network-vif-deleted-c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:01 user nova-compute[75018]: INFO nova.compute.manager [req-d6e7732e-85e4-4f61-be20-8f8e1a977698 req-d54009ad-09f2-4207-a46a-c171113b89a9 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Neutron deleted interface c8446401-eb10-4144-8266-999410a90896; detaching it from the instance and deleting it from the info cache
Nov 07 15:41:01 user nova-compute[75018]: DEBUG nova.network.neutron [req-d6e7732e-85e4-4f61-be20-8f8e1a977698 req-d54009ad-09f2-4207-a46a-c171113b89a9 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:41:01 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Took 1.41 seconds to deallocate network for instance.
Nov 07 15:41:01 user nova-compute[75018]: DEBUG nova.compute.manager [req-d6e7732e-85e4-4f61-be20-8f8e1a977698 req-d54009ad-09f2-4207-a46a-c171113b89a9 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Detach interface failed, port_id=c8446401-eb10-4144-8266-999410a90896, reason: Instance 31e90a00-c2df-493c-9b7e-12d3063b877f could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG nova.compute.manager [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Received event network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] Acquiring lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG nova.compute.manager [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] No waiting events found dispatching network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:41:02 user nova-compute[75018]: WARNING nova.compute.manager [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Received unexpected event network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 for instance with vm_state deleted and task_state None.
Nov 07 15:41:02 user nova-compute[75018]: DEBUG nova.compute.manager [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Received event network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] Acquiring lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG nova.compute.manager [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] No waiting events found dispatching network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:41:02 user nova-compute[75018]: WARNING nova.compute.manager [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Received unexpected event network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 for instance with vm_state deleted and task_state None.
Nov 07 15:41:02 user nova-compute[75018]: DEBUG nova.compute.manager [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Received event network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] Acquiring lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG nova.compute.manager [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] No waiting events found dispatching network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:41:02 user nova-compute[75018]: WARNING nova.compute.manager [req-c0a7c0fd-6c40-4eff-890f-1433d60cdf15 req-c8b6ed5c-cd4a-4c2a-b454-05365c08db45 service nova] [instance: 31e90a00-c2df-493c-9b7e-12d3063b877f] Received unexpected event network-vif-plugged-c8446401-eb10-4144-8266-999410a90896 for instance with vm_state deleted and task_state None.
Nov 07 15:41:02 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:41:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.514s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:02 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Deleted allocations for instance 31e90a00-c2df-493c-9b7e-12d3063b877f
Nov 07 15:41:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0cf619b9-2d6c-42bd-b97e-069b0f87d5d1 tempest-ServersNegativeTestJSON-1403438128 tempest-ServersNegativeTestJSON-1403438128-project-member] Lock "31e90a00-c2df-493c-9b7e-12d3063b877f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.218s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "98c33773-942b-422b-b4fd-a2b548260c09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "98c33773-942b-422b-b4fd-a2b548260c09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:11 user nova-compute[75018]: INFO nova.compute.manager [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Terminating instance
Nov 07 15:41:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG nova.compute.manager [req-a395b29b-7180-4ebf-8620-df0eea89d573 req-3fb09343-6517-40b3-982c-4f86d1d9a4f1 service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Received event network-vif-unplugged-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a395b29b-7180-4ebf-8620-df0eea89d573 req-3fb09343-6517-40b3-982c-4f86d1d9a4f1 service nova] Acquiring lock "98c33773-942b-422b-b4fd-a2b548260c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a395b29b-7180-4ebf-8620-df0eea89d573 req-3fb09343-6517-40b3-982c-4f86d1d9a4f1 service nova] Lock "98c33773-942b-422b-b4fd-a2b548260c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a395b29b-7180-4ebf-8620-df0eea89d573 req-3fb09343-6517-40b3-982c-4f86d1d9a4f1 service nova] Lock "98c33773-942b-422b-b4fd-a2b548260c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG nova.compute.manager [req-a395b29b-7180-4ebf-8620-df0eea89d573 req-3fb09343-6517-40b3-982c-4f86d1d9a4f1 service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] No waiting events found dispatching network-vif-unplugged-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG nova.compute.manager [req-a395b29b-7180-4ebf-8620-df0eea89d573 req-3fb09343-6517-40b3-982c-4f86d1d9a4f1 service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Received event network-vif-unplugged-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:12 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Instance destroyed successfully.
Nov 07 15:41:12 user nova-compute[75018]: DEBUG nova.objects.instance [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lazy-loading 'resources' on Instance uuid 98c33773-942b-422b-b4fd-a2b548260c09 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:36:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2021335938',display_name='tempest-TestServerVolumeAttachmentScenario-server-2021335938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2021335938',id=30,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj6Lb+MDuLa2Cb3vOfLTbl8R5ZeB/z2uueEZdRiotCU45FfL7/xTRsyITLx1f8WgOj5GYxNRza5+/FwcsueVKsmOmBYHAmS+SHBEUk04JxN3NMWYxgsZXjYg5qfAeKmGw==',key_name='tempest-keypair-1204763740',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:36:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e330da770824aad9f8e6c1e312c2e5b',ramdisk_id='',reservation_id='r-ppeoy8l7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2050584835',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2050584835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd323d14ebd4f418ef98952c0efbe29',uuid=98c33773-942b-422b-b4fd-a2b548260c09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "address": "fa:16:3e:6f:c7:ae", "network": {"id": "3bc44c82-a575-4e5c-8661-2411b93b96bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1450868802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e330da770824aad9f8e6c1e312c2e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c33f4e9-4c", "ovs_interfaceid": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Converting VIF {"id": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "address": "fa:16:3e:6f:c7:ae", "network": {"id": "3bc44c82-a575-4e5c-8661-2411b93b96bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1450868802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e330da770824aad9f8e6c1e312c2e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c33f4e9-4c", "ovs_interfaceid": "8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:c7:ae,bridge_name='br-int',has_traffic_filtering=True,id=8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9,network=Network(3bc44c82-a575-4e5c-8661-2411b93b96bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c33f4e9-4c') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG os_vif [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:c7:ae,bridge_name='br-int',has_traffic_filtering=True,id=8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9,network=Network(3bc44c82-a575-4e5c-8661-2411b93b96bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c33f4e9-4c') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c33f4e9-4c, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fb3f3ae-9ed0-45cc-b743-46782bbbb259) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:12 user nova-compute[75018]: INFO os_vif [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:c7:ae,bridge_name='br-int',has_traffic_filtering=True,id=8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9,network=Network(3bc44c82-a575-4e5c-8661-2411b93b96bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c33f4e9-4c')
Nov 07 15:41:12 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Deleting instance files /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09_del
Nov 07 15:41:12 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Deletion of /opt/stack/data/nova/instances/98c33773-942b-422b-b4fd-a2b548260c09_del complete
Nov 07 15:41:12 user nova-compute[75018]: INFO nova.compute.manager [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 07 15:41:12 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:41:12 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:41:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:13 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:41:13 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Took 0.89 seconds to deallocate network for instance.
Nov 07 15:41:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-aa603bf2-fb8b-4d03-8154-4088bdc8d8cf req-bd17c300-9108-40ff-9410-7480611db4aa service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Received event network-vif-deleted-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:14 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:41:14 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:41:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:14 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Deleted allocations for instance 98c33773-942b-422b-b4fd-a2b548260c09
Nov 07 15:41:14 user nova-compute[75018]: DEBUG nova.compute.manager [req-962f133f-d454-4e45-9239-f5a7e37b26c8 req-e443f02a-a7ee-49c5-8d3d-2c49bdc95e8a service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Received event network-vif-plugged-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-962f133f-d454-4e45-9239-f5a7e37b26c8 req-e443f02a-a7ee-49c5-8d3d-2c49bdc95e8a service nova] Acquiring lock "98c33773-942b-422b-b4fd-a2b548260c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-962f133f-d454-4e45-9239-f5a7e37b26c8 req-e443f02a-a7ee-49c5-8d3d-2c49bdc95e8a service nova] Lock "98c33773-942b-422b-b4fd-a2b548260c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-962f133f-d454-4e45-9239-f5a7e37b26c8 req-e443f02a-a7ee-49c5-8d3d-2c49bdc95e8a service nova] Lock "98c33773-942b-422b-b4fd-a2b548260c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:14 user nova-compute[75018]: DEBUG nova.compute.manager [req-962f133f-d454-4e45-9239-f5a7e37b26c8 req-e443f02a-a7ee-49c5-8d3d-2c49bdc95e8a service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] No waiting events found dispatching network-vif-plugged-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:41:14 user nova-compute[75018]: WARNING nova.compute.manager [req-962f133f-d454-4e45-9239-f5a7e37b26c8 req-e443f02a-a7ee-49c5-8d3d-2c49bdc95e8a service nova] [instance: 98c33773-942b-422b-b4fd-a2b548260c09] Received unexpected event network-vif-plugged-8c33f4e9-4c4a-44b1-b66b-2683cc5efcc9 for instance with vm_state deleted and task_state None.
Nov 07 15:41:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-9e62a9b9-f163-41bf-a94b-fd4a501bb5e0 tempest-TestServerVolumeAttachmentScenario-2050584835 tempest-TestServerVolumeAttachmentScenario-2050584835-project-member] Lock "98c33773-942b-422b-b4fd-a2b548260c09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.478s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eoflpvAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:41:19 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:41:19 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:41:19 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b02bde-2bea-4b31-9754-e4adebba1cf2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:41:19 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edcdc3b-8fa1-4ab4-af74-8812c344b293]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce] added
Nov 07 15:41:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0447abff-1b2b-4c56-8e46-d3dcabd7db38]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ea99b8-2287-403f-b56c-70b996bb0587]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eoflpvAE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eoflpvAE" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccbca78-5df7-4f27-bdde-ed312425edc9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eoflpvAE'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc95cd8c-cbd9-4f2f-a886-2e4e696d68a4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac72860-1bea-4985-a9e9-92670dcbdb05]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:19 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:19 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:41:19 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:41:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:19 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:19 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:41:19 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:41:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1c2727-02e5-4b99-b734-2d33f2fbe4ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce, portal: 172.16.0.220,3260]
Nov 07 15:41:19 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce, portal: 172.16.0.220,3260] successful.
Nov 07 15:41:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e44b7b-f809-48f3-9d4f-1eccb4993a66]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7716e6-0dc9-4e9d-ab39-2c37d1881e52]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:19 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:19 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:41:19 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:41:19 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:41:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:19 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:19 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:41:19 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:41:19 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:41:19 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8c9177-df1c-45aa-963a-e44df0c5e2e5]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:19 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:41:20 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:41:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eoflpvAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:41:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:41:20 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23264346662363635', 'path': '/dev/sde'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:41:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264346662363635', 'path': '/dev/sde'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:41:20 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'flavor' on Instance uuid 79aba108-cfd6-4e83-99f5-50403a500a87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:41:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:41:20 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:41:20 user nova-compute[75018]:   <source dev="/dev/sde"/>
Nov 07 15:41:20 user nova-compute[75018]:   <target dev="vdc" bus="virtio"/>
Nov 07 15:41:20 user nova-compute[75018]:   <serial>3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce</serial>
Nov 07 15:41:20 user nova-compute[75018]: </disk>
Nov 07 15:41:20 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:41:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:41:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:41:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:41:20 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] No VIF found with MAC fa:16:3e:77:f2:a5, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:41:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a005fd11-38e9-49da-b768-3b4324c673d1 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.919s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:22 user nova-compute[75018]: INFO nova.compute.manager [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Detaching volume 7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff
Nov 07 15:41:22 user nova-compute[75018]: INFO nova.virt.block_device [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Attempting to driver detach volume 7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff from mountpoint /dev/vdb
Nov 07 15:41:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Attempting to detach device vdb from instance 79aba108-cfd6-4e83-99f5-50403a500a87 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:41:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:41:22 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:41:22 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:41:22 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:41:22 user nova-compute[75018]:   <serial>7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff</serial>
Nov 07 15:41:22 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:41:22 user nova-compute[75018]: </disk>
Nov 07 15:41:22 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:41:22 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Successfully detached device vdb from instance 79aba108-cfd6-4e83-99f5-50403a500a87 from the persistent domain config.
Nov 07 15:41:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79aba108-cfd6-4e83-99f5-50403a500a87 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:41:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:41:22 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:41:22 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:41:22 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:41:22 user nova-compute[75018]:   <serial>7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff</serial>
Nov 07 15:41:22 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:41:22 user nova-compute[75018]: </disk>
Nov 07 15:41:22 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:41:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79aba108-cfd6-4e83-99f5-50403a500a87 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:41:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "1f86ee09-062b-428d-9870-14de77c569c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "1f86ee09-062b-428d-9870-14de77c569c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:23 user nova-compute[75018]: INFO nova.compute.manager [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Detaching volume 8d0384bc-b22d-4541-94c2-93ee6165804b
Nov 07 15:41:23 user nova-compute[75018]: INFO nova.virt.block_device [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Attempting to driver detach volume 8d0384bc-b22d-4541-94c2-93ee6165804b from mountpoint /dev/vdb
Nov 07 15:41:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Attempting to detach device vdb from instance 1f86ee09-062b-428d-9870-14de77c569c0 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:41:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:41:23 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:41:23 user nova-compute[75018]:   <source dev="/dev/sdf"/>
Nov 07 15:41:23 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:41:23 user nova-compute[75018]:   <serial>8d0384bc-b22d-4541-94c2-93ee6165804b</serial>
Nov 07 15:41:23 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:41:23 user nova-compute[75018]: </disk>
Nov 07 15:41:23 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:41:23 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Successfully detached device vdb from instance 1f86ee09-062b-428d-9870-14de77c569c0 from the persistent domain config.
Nov 07 15:41:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f86ee09-062b-428d-9870-14de77c569c0 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:41:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:41:23 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:41:23 user nova-compute[75018]:   <source dev="/dev/sdf"/>
Nov 07 15:41:23 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:41:23 user nova-compute[75018]:   <serial>8d0384bc-b22d-4541-94c2-93ee6165804b</serial>
Nov 07 15:41:23 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:41:23 user nova-compute[75018]: </disk>
Nov 07 15:41:23 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:41:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "1f86ee09-062b-428d-9870-14de77c569c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f86ee09-062b-428d-9870-14de77c569c0 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Starting finish_migration {{(pid=75018) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Instance directory exists: not creating {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 15:41:25 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Creating image(s)
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Did not create local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Ensure instance console log exists: /opt/stack/data/nova/instances/da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Start _get_guest_xml network_info=[{"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-259037608-network", "vif_mac": "fa:16:3e:a4:c0:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxOItsEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb', 'attached_at': '2023-11-07T15:41:26.000000', 'detached_at': '', 'volume_id': 'f217d4a6-0a2e-4da7-890e-edb3c57426ee', 'serial': 'f217d4a6-0a2e-4da7-890e-edb3c57426ee'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'aecf137e-26f0-4608-971b-a26ac205368b', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:41:25 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:41:25 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxOItsEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:41:25 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:41:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:41:25 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:41:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:41:25 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:41:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d9d2bf-ec26-47aa-b67d-69174f8d7d0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:41:25 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8949710-864b-43d0-8694-d610fe758765]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee] added
Nov 07 15:41:26 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc013cd-3c22-48e5-bd12-8c0b837c6a77]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd10a109-1db5-48e1-9307-a78002d1d682]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxOItsEA {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxOItsEA" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae4bcb-8926-403c-b611-a49b9602353c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LxOItsEA'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[10719f14-f622-4048-b5b8-b3c4efabdac8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c50613e-584a-4e72-99db-ff797da694a3]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:41:26 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:41:26 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bd3799-47b1-4155-a511-6e1678df3f26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260]
Nov 07 15:41:26 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260] successful.
Nov 07 15:41:26 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c232b7-0340-4b5f-bf8b-d8369db36835]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a88a76f-1348-4d49-9e92-024f1d6b1a19]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:41:26 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:41:26 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:41:26 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9818c06-8586-4260-ae95-ae8e8572c63d]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:26 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxOItsEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23336636633623034', 'path': '/dev/sdg'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336636633623034', 'path': '/dev/sdg'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-68415212',display_name='tempest-ServerActionsTestOtherA-server-68415212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-68415212',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWUuR4eTrthHIodCYA4J9kJfg+RXJSyXAWybmq/Ac2FttoM8S/nLdDec5RLFtfiG+hcM5DvHo1f+xa7mxv4L56s6Q3dpUvRcBzbdTOGBBvgSiAYU0HY5RSxW2+5w/RcXA==',key_name='tempest-keypair-2049594144',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:39:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-xtwasur4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:40:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-259037608-network", "vif_mac": "fa:16:3e:a4:c0:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-259037608-network", "vif_mac": "fa:16:3e:a4:c0:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=83dd20e9-5978-4447-b595-18937fab35d5,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dd20e9-59') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:41:27 user nova-compute[75018]:   <uuid>da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb</uuid>
Nov 07 15:41:27 user nova-compute[75018]:   <name>instance-00000023</name>
Nov 07 15:41:27 user nova-compute[75018]:   <memory>2097152</memory>
Nov 07 15:41:27 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:41:27 user nova-compute[75018]:   <metadata>
Nov 07 15:41:27 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:41:27 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:41:27 user nova-compute[75018]:       <nova:name>tempest-ServerActionsTestOtherA-server-68415212</nova:name>
Nov 07 15:41:27 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:41:25</nova:creationTime>
Nov 07 15:41:27 user nova-compute[75018]:       <nova:flavor name="m1.small">
Nov 07 15:41:27 user nova-compute[75018]:         <nova:memory>2048</nova:memory>
Nov 07 15:41:27 user nova-compute[75018]:         <nova:disk>20</nova:disk>
Nov 07 15:41:27 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:41:27 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:41:27 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:41:27 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:41:27 user nova-compute[75018]:       <nova:owner>
Nov 07 15:41:27 user nova-compute[75018]:         <nova:user uuid="c6b39ca6e2db4be9a71fca8389bce83f">tempest-ServerActionsTestOtherA-1198683339-project-member</nova:user>
Nov 07 15:41:27 user nova-compute[75018]:         <nova:project uuid="8da5c809b9e14547855ac986915e8c99">tempest-ServerActionsTestOtherA-1198683339</nova:project>
Nov 07 15:41:27 user nova-compute[75018]:       </nova:owner>
Nov 07 15:41:27 user nova-compute[75018]:       <nova:ports>
Nov 07 15:41:27 user nova-compute[75018]:         <nova:port uuid="83dd20e9-5978-4447-b595-18937fab35d5">
Nov 07 15:41:27 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 07 15:41:27 user nova-compute[75018]:         </nova:port>
Nov 07 15:41:27 user nova-compute[75018]:       </nova:ports>
Nov 07 15:41:27 user nova-compute[75018]:     </nova:instance>
Nov 07 15:41:27 user nova-compute[75018]:   </metadata>
Nov 07 15:41:27 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:41:27 user nova-compute[75018]:     <system>
Nov 07 15:41:27 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:41:27 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:41:27 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:41:27 user nova-compute[75018]:       <entry name="serial">da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb</entry>
Nov 07 15:41:27 user nova-compute[75018]:       <entry name="uuid">da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb</entry>
Nov 07 15:41:27 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:41:27 user nova-compute[75018]:     </system>
Nov 07 15:41:27 user nova-compute[75018]:   </sysinfo>
Nov 07 15:41:27 user nova-compute[75018]:   <os>
Nov 07 15:41:27 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:41:27 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:41:27 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:41:27 user nova-compute[75018]:   </os>
Nov 07 15:41:27 user nova-compute[75018]:   <features>
Nov 07 15:41:27 user nova-compute[75018]:     <acpi/>
Nov 07 15:41:27 user nova-compute[75018]:     <apic/>
Nov 07 15:41:27 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:41:27 user nova-compute[75018]:   </features>
Nov 07 15:41:27 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:41:27 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:41:27 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:41:27 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:41:27 user nova-compute[75018]:   </clock>
Nov 07 15:41:27 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:41:27 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:41:27 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:41:27 user nova-compute[75018]:   </cpu>
Nov 07 15:41:27 user nova-compute[75018]:   <devices>
Nov 07 15:41:27 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:41:27 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:41:27 user nova-compute[75018]:       <source dev="/dev/sdg"/>
Nov 07 15:41:27 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:41:27 user nova-compute[75018]:       <serial>f217d4a6-0a2e-4da7-890e-edb3c57426ee</serial>
Nov 07 15:41:27 user nova-compute[75018]:     </disk>
Nov 07 15:41:27 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:41:27 user nova-compute[75018]:       <mac address="fa:16:3e:a4:c0:dc"/>
Nov 07 15:41:27 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:41:27 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:41:27 user nova-compute[75018]:       <target dev="tap83dd20e9-59"/>
Nov 07 15:41:27 user nova-compute[75018]:     </interface>
Nov 07 15:41:27 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:41:27 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb/console.log" append="off"/>
Nov 07 15:41:27 user nova-compute[75018]:     </serial>
Nov 07 15:41:27 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:41:27 user nova-compute[75018]:     <video>
Nov 07 15:41:27 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:41:27 user nova-compute[75018]:     </video>
Nov 07 15:41:27 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:41:27 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:41:27 user nova-compute[75018]:     </rng>
Nov 07 15:41:27 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:41:27 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:41:27 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:41:27 user nova-compute[75018]:     </memballoon>
Nov 07 15:41:27 user nova-compute[75018]:   </devices>
Nov 07 15:41:27 user nova-compute[75018]: </domain>
Nov 07 15:41:27 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-68415212',display_name='tempest-ServerActionsTestOtherA-server-68415212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-68415212',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWUuR4eTrthHIodCYA4J9kJfg+RXJSyXAWybmq/Ac2FttoM8S/nLdDec5RLFtfiG+hcM5DvHo1f+xa7mxv4L56s6Q3dpUvRcBzbdTOGBBvgSiAYU0HY5RSxW2+5w/RcXA==',key_name='tempest-keypair-2049594144',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:39:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-xtwasur4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:40:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-259037608-network", "vif_mac": "fa:16:3e:a4:c0:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-259037608-network", "vif_mac": "fa:16:3e:a4:c0:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=83dd20e9-5978-4447-b595-18937fab35d5,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dd20e9-59') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG os_vif [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=83dd20e9-5978-4447-b595-18937fab35d5,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dd20e9-59') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dc78e59-6ab1-5125-86d3-82e4f5ba0c51', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83dd20e9-59, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83dd20e9-59, col_values=(('qos', UUID('17716888-97a3-4680-a88f-84f63faa4fe5')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83dd20e9-59, col_values=(('external_ids', {'iface-id': '83dd20e9-5978-4447-b595-18937fab35d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:c0:dc', 'vm-uuid': 'da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:27 user nova-compute[75018]: INFO os_vif [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=83dd20e9-5978-4447-b595-18937fab35d5,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dd20e9-59')
Nov 07 15:41:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:41:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] No VIF found with MAC fa:16:3e:a4:c0:dc, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:41:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-2de19816-c9f9-4bc4-bd9b-e0e35766ef73 req-82d28c11-b459-4459-a449-a329aa0900a2 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received event network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2de19816-c9f9-4bc4-bd9b-e0e35766ef73 req-82d28c11-b459-4459-a449-a329aa0900a2 service nova] Acquiring lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2de19816-c9f9-4bc4-bd9b-e0e35766ef73 req-82d28c11-b459-4459-a449-a329aa0900a2 service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2de19816-c9f9-4bc4-bd9b-e0e35766ef73 req-82d28c11-b459-4459-a449-a329aa0900a2 service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-2de19816-c9f9-4bc4-bd9b-e0e35766ef73 req-82d28c11-b459-4459-a449-a329aa0900a2 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] No waiting events found dispatching network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:41:28 user nova-compute[75018]: WARNING nova.compute.manager [req-2de19816-c9f9-4bc4-bd9b-e0e35766ef73 req-82d28c11-b459-4459-a449-a329aa0900a2 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received unexpected event network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 for instance with vm_state active and task_state resize_finish.
Nov 07 15:41:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:41:30 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Instance running successfully.
Nov 07 15:41:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Failed to set time: agent not configured {{(pid=75018) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 07 15:41:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-4e3fdb42-b72f-4147-a364-910a5a4b6256 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] finish_migration finished successfully. {{(pid=75018) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 07 15:41:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-a1bd7137-7544-48a9-9d5d-2cf7f6c9a9b2 req-976dbff1-ca66-42cb-b819-9b6c3fab6ce4 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received event network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a1bd7137-7544-48a9-9d5d-2cf7f6c9a9b2 req-976dbff1-ca66-42cb-b819-9b6c3fab6ce4 service nova] Acquiring lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a1bd7137-7544-48a9-9d5d-2cf7f6c9a9b2 req-976dbff1-ca66-42cb-b819-9b6c3fab6ce4 service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a1bd7137-7544-48a9-9d5d-2cf7f6c9a9b2 req-976dbff1-ca66-42cb-b819-9b6c3fab6ce4 service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-a1bd7137-7544-48a9-9d5d-2cf7f6c9a9b2 req-976dbff1-ca66-42cb-b819-9b6c3fab6ce4 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] No waiting events found dispatching network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:41:30 user nova-compute[75018]: WARNING nova.compute.manager [req-a1bd7137-7544-48a9-9d5d-2cf7f6c9a9b2 req-976dbff1-ca66-42cb-b819-9b6c3fab6ce4 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received unexpected event network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 for instance with vm_state resized and task_state None.
Nov 07 15:41:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:41:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:41:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:41:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:33 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:41:35 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:41:35 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:41:36 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:41:36 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:41:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 15:41:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] There are 0 instances to clean {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 15:41:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:41:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:41:37 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:41:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:41:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:41:37 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:41:38 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updating instance_info_cache with network_info: [{"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:41:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:41:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:41:41 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:41:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:41 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:41:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:42 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 79aba108-cfd6-4e83-99f5-50403a500a87 is timed out.
Nov 07 15:41:42 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Successfully detached device vdb from instance 79aba108-cfd6-4e83-99f5-50403a500a87 from the live domain config.
Nov 07 15:41:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nBkzxSeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:41:42 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:41:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e543ca-6a7f-4752-a6f5-ffc0c64add63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:41:42 user nova-compute[75018]: No targets found.
Nov 07 15:41:42 user nova-compute[75018]: iSNS:
Nov 07 15:41:42 user nova-compute[75018]: No targets found.
Nov 07 15:41:42 user nova-compute[75018]: STATIC:
Nov 07 15:41:42 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce
Nov 07 15:41:42 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:42 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:42 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444
Nov 07 15:41:42 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:42 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:42 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee
Nov 07 15:41:42 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:42 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:42 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823
Nov 07 15:41:42 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:42 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:42 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff
Nov 07 15:41:42 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:42 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:42 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b
Nov 07 15:41:42 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:42 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:42 user nova-compute[75018]: FIRMWARE:
Nov 07 15:41:42 user nova-compute[75018]: No targets found.
Nov 07 15:41:42 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:41:42 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:41:42 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:41:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[becfba6c-a8ea-4363-bdf7-8b8168841e8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[817c824b-c98d-4d35-a66d-7c8c9d3d0377]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:41:43 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:41:43 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae055f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff'): ({'sdd'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Removing single pathed devices sdd {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[738d2b32-6e50-4a77-b74b-b63a5b06159b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b41fbbf-a22a-4f81-b923-7fc29feb2b68]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Flushing IO for device /dev/sdd {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b5e278-b6f4-4152-be92-8af295d2465d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e62d7ff-3c40-44d7-8c8a-3017562c66ab]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0cbdc3-95d1-46c1-8de8-d65d3f341a02]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a9faa9-e542-4721-be89-bd1fd80d2c57]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff, portal: 172.16.0.220,3260]
Nov 07 15:41:43 user nova-compute[75018]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff, portal: 172.16.0.220,3260] successful.
Nov 07 15:41:43 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c5bc183-6f2c-4ff0-bfb6-2b213274f8ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0c2928-146f-4b12-9bf3-805c7c5150ca]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] <== disconnect_volume: return (383ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1f86ee09-062b-428d-9870-14de77c569c0 is timed out.
Nov 07 15:41:43 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Successfully detached device vdb from instance 1f86ee09-062b-428d-9870-14de77c569c0 from the live domain config.
Nov 07 15:41:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHijPFGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:41:43 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be537e0-c6e6-409d-9c86-1812d9cf15d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:41:43 user nova-compute[75018]: No targets found.
Nov 07 15:41:43 user nova-compute[75018]: iSNS:
Nov 07 15:41:43 user nova-compute[75018]: No targets found.
Nov 07 15:41:43 user nova-compute[75018]: STATIC:
Nov 07 15:41:43 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce
Nov 07 15:41:43 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:43 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:43 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444
Nov 07 15:41:43 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:43 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:43 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee
Nov 07 15:41:43 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:43 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:43 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823
Nov 07 15:41:43 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:43 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:43 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b
Nov 07 15:41:43 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:43 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:43 user nova-compute[75018]: FIRMWARE:
Nov 07 15:41:43 user nova-compute[75018]: No targets found.
Nov 07 15:41:43 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:41:43 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:41:43 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5937fc05-57f7-4c9c-8643-2c4ab5e500b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ef2ca7-b457-429f-acbc-9288f5a0e5fa]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:41:43 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:41:43 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:41:43 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae055dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b'): ({'sdf'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Removing single pathed devices sdf {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[570a2a61-d7e5-4e8f-a57c-04467634eada]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e21bda-b3e0-4bf3-af5b-85b5292ff679]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Flushing IO for device /dev/sdf {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:41:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2740c8b8-0773-4433-96c6-be30e0a6b703]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43252ca-52bc-407c-a6d4-1961b81dd234]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] SCSI volumes sdf have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e32a76-08b4-4662-888b-ae7e23671c5d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[112cc21c-ebd9-498b-8902-6d7625d2b168]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b, portal: 172.16.0.220,3260]
Nov 07 15:41:44 user nova-compute[75018]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b, portal: 172.16.0.220,3260] successful.
Nov 07 15:41:44 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[614728d5-268e-45ac-97da-6c5a9dab3b19]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.424s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] <== disconnect_volume: return (426ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'flavor' on Instance uuid 79aba108-cfd6-4e83-99f5-50403a500a87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5af66719-d2b4-4768-afcc-0249d5fd1d1d tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.965s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:45 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:41:45 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7708MB free_disk=25.049007415771484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:45 user nova-compute[75018]: INFO nova.compute.manager [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Detaching volume 3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce
Nov 07 15:41:45 user nova-compute[75018]: INFO nova.virt.block_device [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Attempting to driver detach volume 3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce from mountpoint /dev/vdc
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.objects.instance [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lazy-loading 'flavor' on Instance uuid 1f86ee09-062b-428d-9870-14de77c569c0 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Applying migration context for instance da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb as it has an incoming, in-progress migration 186d34d9-58f3-462a-9aff-bb7fb3631d98. Migration status is finished {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 07 15:41:45 user nova-compute[75018]: INFO nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Updating resource usage from migration 186d34d9-58f3-462a-9aff-bb7fb3631d98
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Attempting to detach device vdc from instance 79aba108-cfd6-4e83-99f5-50403a500a87 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:41:45 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:41:45 user nova-compute[75018]:   <source dev="/dev/sde"/>
Nov 07 15:41:45 user nova-compute[75018]:   <target dev="vdc" bus="virtio"/>
Nov 07 15:41:45 user nova-compute[75018]:   <serial>3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce</serial>
Nov 07 15:41:45 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 07 15:41:45 user nova-compute[75018]: </disk>
Nov 07 15:41:45 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f4074d90-fc26-4068-a36d-e02e2cbd49b7 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "1f86ee09-062b-428d-9870-14de77c569c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.151s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "1f86ee09-062b-428d-9870-14de77c569c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.955s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "1f86ee09-062b-428d-9870-14de77c569c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "1f86ee09-062b-428d-9870-14de77c569c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "1f86ee09-062b-428d-9870-14de77c569c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:45 user nova-compute[75018]: INFO nova.compute.manager [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Terminating instance
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:41:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Successfully detached device vdc from instance 79aba108-cfd6-4e83-99f5-50403a500a87 from the persistent domain config.
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 79aba108-cfd6-4e83-99f5-50403a500a87 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:41:45 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:41:45 user nova-compute[75018]:   <source dev="/dev/sde"/>
Nov 07 15:41:45 user nova-compute[75018]:   <target dev="vdc" bus="virtio"/>
Nov 07 15:41:45 user nova-compute[75018]:   <serial>3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce</serial>
Nov 07 15:41:45 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 07 15:41:45 user nova-compute[75018]: </disk>
Nov 07 15:41:45 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e4ad018d-bdc7-458b-9e77-ba31457e52ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 4bf14e55-beb3-4800-8472-3436fa21b45e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1f86ee09-062b-428d-9870-14de77c569c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 79aba108-cfd6-4e83-99f5-50403a500a87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 7d054231-82b5-43b0-967a-78f5ef690090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Migration 186d34d9-58f3-462a-9aff-bb7fb3631d98 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing inventories for resource provider 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating ProviderTree inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-d3811fa8-39ab-4831-99da-ba5c67541eb3 req-223e7be6-a4ce-4ecd-9df9-7c07ff189b85 service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Received event network-vif-unplugged-58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d3811fa8-39ab-4831-99da-ba5c67541eb3 req-223e7be6-a4ce-4ecd-9df9-7c07ff189b85 service nova] Acquiring lock "1f86ee09-062b-428d-9870-14de77c569c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d3811fa8-39ab-4831-99da-ba5c67541eb3 req-223e7be6-a4ce-4ecd-9df9-7c07ff189b85 service nova] Lock "1f86ee09-062b-428d-9870-14de77c569c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d3811fa8-39ab-4831-99da-ba5c67541eb3 req-223e7be6-a4ce-4ecd-9df9-7c07ff189b85 service nova] Lock "1f86ee09-062b-428d-9870-14de77c569c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-d3811fa8-39ab-4831-99da-ba5c67541eb3 req-223e7be6-a4ce-4ecd-9df9-7c07ff189b85 service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] No waiting events found dispatching network-vif-unplugged-58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-d3811fa8-39ab-4831-99da-ba5c67541eb3 req-223e7be6-a4ce-4ecd-9df9-7c07ff189b85 service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Received event network-vif-unplugged-58e42c23-4f3b-4394-aa4f-42ae19671af0 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing aggregate associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, aggregates: None {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing trait associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 79aba108-cfd6-4e83-99f5-50403a500a87 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:41:45 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.824s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75018) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:46 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Instance destroyed successfully.
Nov 07 15:41:46 user nova-compute[75018]: DEBUG nova.objects.instance [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lazy-loading 'resources' on Instance uuid 1f86ee09-062b-428d-9870-14de77c569c0 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2126507144',display_name='tempest-VolumesSnapshotTestJSON-instance-2126507144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2126507144',id=32,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlY2/46CmIE9HAOg6uM47VamWHCN9jj5bRPiISK3bDDqPq0J7mD0y/J2EY3HTcjsLRVqTsTpeOsMB8zbNCoYL2SkDDA5oFbziEOhX5Xm6ZSUdutN07qDC27WqUm8g85vQ==',key_name='tempest-keypair-1976970800',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0d39d9835e04ea393a5c6ef8046aac2',ramdisk_id='',reservation_id='r-zpfj0kcj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-666600934',owner_user_name='tempest-VolumesSnapshotTestJSON-666600934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ecef8d2ab1c490d98e9f65e16241cf1',uuid=1f86ee09-062b-428d-9870-14de77c569c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "address": "fa:16:3e:24:bd:89", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e42c23-4f", "ovs_interfaceid": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Converting VIF {"id": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "address": "fa:16:3e:24:bd:89", "network": {"id": "85503726-f3c9-4bad-958c-d4bade647236", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-440924892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d39d9835e04ea393a5c6ef8046aac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e42c23-4f", "ovs_interfaceid": "58e42c23-4f3b-4394-aa4f-42ae19671af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:bd:89,bridge_name='br-int',has_traffic_filtering=True,id=58e42c23-4f3b-4394-aa4f-42ae19671af0,network=Network(85503726-f3c9-4bad-958c-d4bade647236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e42c23-4f') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG os_vif [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:bd:89,bridge_name='br-int',has_traffic_filtering=True,id=58e42c23-4f3b-4394-aa4f-42ae19671af0,network=Network(85503726-f3c9-4bad-958c-d4bade647236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e42c23-4f') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58e42c23-4f, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88adb19c-6998-48ce-809a-f81a2e34a806) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:46 user nova-compute[75018]: INFO os_vif [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:bd:89,bridge_name='br-int',has_traffic_filtering=True,id=58e42c23-4f3b-4394-aa4f-42ae19671af0,network=Network(85503726-f3c9-4bad-958c-d4bade647236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e42c23-4f')
Nov 07 15:41:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YHijPFGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:41:46 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:41:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cacdae-6743-4f80-9f50-673fb6a7c327]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:41:46 user nova-compute[75018]: No targets found.
Nov 07 15:41:46 user nova-compute[75018]: iSNS:
Nov 07 15:41:46 user nova-compute[75018]: No targets found.
Nov 07 15:41:46 user nova-compute[75018]: STATIC:
Nov 07 15:41:46 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce
Nov 07 15:41:46 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:46 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:46 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444
Nov 07 15:41:46 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:46 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:46 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee
Nov 07 15:41:46 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:46 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:46 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823
Nov 07 15:41:46 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:46 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:46 user nova-compute[75018]: FIRMWARE:
Nov 07 15:41:46 user nova-compute[75018]: No targets found.
Nov 07 15:41:46 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:41:46 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:41:46 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d0384bc-b22d-4541-94c2-93ee6165804b', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e26fc1-d3fe-40c6-9e46-38ac863eaa6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fd718d-2155-411d-bc5e-b8eabb84fe30]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:46 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:46 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:41:46 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:41:46 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:46 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:46 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:41:46 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:41:46 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb00381c60>, {}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Disconnecting from: [] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] <== disconnect_volume: return (74ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:41:46 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Deleting instance files /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0_del
Nov 07 15:41:46 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Deletion of /opt/stack/data/nova/instances/1f86ee09-062b-428d-9870-14de77c569c0_del complete
Nov 07 15:41:46 user nova-compute[75018]: INFO nova.compute.manager [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 07 15:41:46 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:41:46 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:41:47 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:41:47 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Took 0.71 seconds to deallocate network for instance.
Nov 07 15:41:47 user nova-compute[75018]: WARNING nova.volume.cinder [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Attachment e1cdc9d1-4460-4cb1-892d-71d2861c1a47 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e1cdc9d1-4460-4cb1-892d-71d2861c1a47. (HTTP 404) (Request-ID: req-2cb33621-411e-4053-8aa0-4cc402d56d6d)
Nov 07 15:41:47 user nova-compute[75018]: INFO nova.compute.manager [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Took 0.02 seconds to detach 1 volumes for instance.
Nov 07 15:41:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:47 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:41:47 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:41:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:47 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Deleted allocations for instance 1f86ee09-062b-428d-9870-14de77c569c0
Nov 07 15:41:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-8a9c2261-d4ef-408c-95b0-7fcd50856124 tempest-VolumesSnapshotTestJSON-666600934 tempest-VolumesSnapshotTestJSON-666600934-project-member] Lock "1f86ee09-062b-428d-9870-14de77c569c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.303s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-ae44568f-ace4-4941-a57d-7dd3841c56d7 req-dc275590-88e6-41e1-b5ec-620a81b77963 service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Received event network-vif-plugged-58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ae44568f-ace4-4941-a57d-7dd3841c56d7 req-dc275590-88e6-41e1-b5ec-620a81b77963 service nova] Acquiring lock "1f86ee09-062b-428d-9870-14de77c569c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ae44568f-ace4-4941-a57d-7dd3841c56d7 req-dc275590-88e6-41e1-b5ec-620a81b77963 service nova] Lock "1f86ee09-062b-428d-9870-14de77c569c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ae44568f-ace4-4941-a57d-7dd3841c56d7 req-dc275590-88e6-41e1-b5ec-620a81b77963 service nova] Lock "1f86ee09-062b-428d-9870-14de77c569c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-ae44568f-ace4-4941-a57d-7dd3841c56d7 req-dc275590-88e6-41e1-b5ec-620a81b77963 service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] No waiting events found dispatching network-vif-plugged-58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:41:47 user nova-compute[75018]: WARNING nova.compute.manager [req-ae44568f-ace4-4941-a57d-7dd3841c56d7 req-dc275590-88e6-41e1-b5ec-620a81b77963 service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Received unexpected event network-vif-plugged-58e42c23-4f3b-4394-aa4f-42ae19671af0 for instance with vm_state deleted and task_state None.
Nov 07 15:41:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-ae44568f-ace4-4941-a57d-7dd3841c56d7 req-dc275590-88e6-41e1-b5ec-620a81b77963 service nova] [instance: 1f86ee09-062b-428d-9870-14de77c569c0] Received event network-vif-deleted-58e42c23-4f3b-4394-aa4f-42ae19671af0 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:48 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:41:48 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:41:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "4bf14e55-beb3-4800-8472-3436fa21b45e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:51 user nova-compute[75018]: INFO nova.compute.manager [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Terminating instance
Nov 07 15:41:51 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:41:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-89990b7c-5daf-4322-ad34-1b0659fa27cf req-c93fbc48-5e1b-4e9a-9c5d-f8af4be6898a service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Received event network-vif-unplugged-fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-89990b7c-5daf-4322-ad34-1b0659fa27cf req-c93fbc48-5e1b-4e9a-9c5d-f8af4be6898a service nova] Acquiring lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-89990b7c-5daf-4322-ad34-1b0659fa27cf req-c93fbc48-5e1b-4e9a-9c5d-f8af4be6898a service nova] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-89990b7c-5daf-4322-ad34-1b0659fa27cf req-c93fbc48-5e1b-4e9a-9c5d-f8af4be6898a service nova] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-89990b7c-5daf-4322-ad34-1b0659fa27cf req-c93fbc48-5e1b-4e9a-9c5d-f8af4be6898a service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] No waiting events found dispatching network-vif-unplugged-fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG nova.compute.manager [req-89990b7c-5daf-4322-ad34-1b0659fa27cf req-c93fbc48-5e1b-4e9a-9c5d-f8af4be6898a service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Received event network-vif-unplugged-fb52e207-387c-43d0-9382-dcde18f34a8e for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:52 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Instance destroyed successfully.
Nov 07 15:41:52 user nova-compute[75018]: DEBUG nova.objects.instance [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lazy-loading 'resources' on Instance uuid 4bf14e55-beb3-4800-8472-3436fa21b45e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:36:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2113511336',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2113511336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2113511336',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9HhKgcHk/NT2mVzDJWzQtEE1JQawGHZhRXbtORdt+jyc5YQH7k8KoIlGtupQDNUP6Iad7DMyGmo1qmPXsuZ9l3eNIvyB2x9UsTMuGM2jpeXk9z5lwRerR82n947AWNjw==',key_name='tempest-keypair-393790816',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:37:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='772e759d9a1d4d18ae43f53c731f87f2',ramdisk_id='',reservation_id='r-axpvru6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1644595019',owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ae23950e1e84c9693f8098c270ecb55',uuid=4bf14e55-beb3-4800-8472-3436fa21b45e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb52e207-387c-43d0-9382-dcde18f34a8e", "address": "fa:16:3e:87:db:1b", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e207-38", "ovs_interfaceid": "fb52e207-387c-43d0-9382-dcde18f34a8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converting VIF {"id": "fb52e207-387c-43d0-9382-dcde18f34a8e", "address": "fa:16:3e:87:db:1b", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e207-38", "ovs_interfaceid": "fb52e207-387c-43d0-9382-dcde18f34a8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:db:1b,bridge_name='br-int',has_traffic_filtering=True,id=fb52e207-387c-43d0-9382-dcde18f34a8e,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb52e207-38') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_vif [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:db:1b,bridge_name='br-int',has_traffic_filtering=True,id=fb52e207-387c-43d0-9382-dcde18f34a8e,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb52e207-38') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb52e207-38, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ded4f5d-0eaf-4e48-b293-f71c75aa0c8a) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:41:52 user nova-compute[75018]: INFO os_vif [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:db:1b,bridge_name='br-int',has_traffic_filtering=True,id=fb52e207-387c-43d0-9382-dcde18f34a8e,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb52e207-38')
Nov 07 15:41:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leNjJLXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:41:52 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4178a896-3e74-4e77-aa68-a3950dc829fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:41:52 user nova-compute[75018]: No targets found.
Nov 07 15:41:52 user nova-compute[75018]: iSNS:
Nov 07 15:41:52 user nova-compute[75018]: No targets found.
Nov 07 15:41:52 user nova-compute[75018]: STATIC:
Nov 07 15:41:52 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce
Nov 07 15:41:52 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:52 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:52 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444
Nov 07 15:41:52 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:52 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:52 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee
Nov 07 15:41:52 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:52 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:52 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823
Nov 07 15:41:52 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:41:52 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:41:52 user nova-compute[75018]: FIRMWARE:
Nov 07 15:41:52 user nova-compute[75018]: No targets found.
Nov 07 15:41:52 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:41:52 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:41:52 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2af3bd0-741b-47a2-81fa-5621cd950165]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a2dfbe-564e-44f0-9ba5-d28229ace0ad]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:52 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:52 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:41:52 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:41:52 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 (non-flash)
Nov 07 15:41:52 user nova-compute[75018]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:41:52 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:41:52 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:41:52 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feaf82e6d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccb8768-5d36-4c74-91f5-f46ab5188a90]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ececbd-5b69-488c-861f-3994db84b797]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40d4b34-2ce5-46a7-8594-09d679abb758]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd33636-9635-44cb-be4b-8439b2336aa2]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc1ef115a-ccbb82630dc0b32b', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c1ef115a', '/dev/disk/by-id/scsi-26363626238323633') {{(pid=86127) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d5ae2f-09c7-4735-8bcc-1add40817623]: (4, None) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1580f552-355d-4fff-9025-064856456834]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --logout" returned: 0 in 0.144s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6849c82-d7b8-45fd-ae2b-1abd5f01ba45]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823, portal: 172.16.0.220,3260]
Nov 07 15:41:52 user nova-compute[75018]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823, portal: 172.16.0.220,3260] successful.
Nov 07 15:41:52 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6b61808-9e09-4193-aa84-dcddd725a823 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7528ba-0c42-44df-8283-45c95e665ffc]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] <== disconnect_volume: return (423ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:41:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:41:53 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Deleting instance files /opt/stack/data/nova/instances/4bf14e55-beb3-4800-8472-3436fa21b45e_del
Nov 07 15:41:53 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Deletion of /opt/stack/data/nova/instances/4bf14e55-beb3-4800-8472-3436fa21b45e_del complete
Nov 07 15:41:53 user nova-compute[75018]: INFO nova.compute.manager [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 07 15:41:53 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:41:53 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:41:53 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:41:54 user nova-compute[75018]: DEBUG nova.compute.manager [req-f70529d1-27e6-4875-9c35-c8aa6c17e455 req-38edb796-dfc0-41e9-85bc-0a07f5b65647 service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Received event network-vif-plugged-fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f70529d1-27e6-4875-9c35-c8aa6c17e455 req-38edb796-dfc0-41e9-85bc-0a07f5b65647 service nova] Acquiring lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f70529d1-27e6-4875-9c35-c8aa6c17e455 req-38edb796-dfc0-41e9-85bc-0a07f5b65647 service nova] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f70529d1-27e6-4875-9c35-c8aa6c17e455 req-38edb796-dfc0-41e9-85bc-0a07f5b65647 service nova] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:54 user nova-compute[75018]: DEBUG nova.compute.manager [req-f70529d1-27e6-4875-9c35-c8aa6c17e455 req-38edb796-dfc0-41e9-85bc-0a07f5b65647 service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] No waiting events found dispatching network-vif-plugged-fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:41:54 user nova-compute[75018]: WARNING nova.compute.manager [req-f70529d1-27e6-4875-9c35-c8aa6c17e455 req-38edb796-dfc0-41e9-85bc-0a07f5b65647 service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Received unexpected event network-vif-plugged-fb52e207-387c-43d0-9382-dcde18f34a8e for instance with vm_state active and task_state deleting.
Nov 07 15:41:54 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:41:54 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Took 1.40 seconds to deallocate network for instance.
Nov 07 15:41:55 user nova-compute[75018]: INFO nova.compute.manager [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Took 0.94 seconds to detach 1 volumes for instance.
Nov 07 15:41:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Deleting volume: d6b61808-9e09-4193-aa84-dcddd725a823 {{(pid=75018) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 07 15:41:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:41:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:41:55 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:41:55 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:41:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:55 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Deleted allocations for instance 4bf14e55-beb3-4800-8472-3436fa21b45e
Nov 07 15:41:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f837b532-6d1d-4593-b3a8-3c036f2dcafe tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "4bf14e55-beb3-4800-8472-3436fa21b45e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.173s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:41:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:41:56 user nova-compute[75018]: DEBUG nova.compute.manager [req-4b222357-4e11-4d2a-a2bc-4ef0257c8571 req-5ad03056-ee40-443c-b245-b595b929cf7b service nova] [instance: 4bf14e55-beb3-4800-8472-3436fa21b45e] Received event network-vif-deleted-fb52e207-387c-43d0-9382-dcde18f34a8e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:41:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:05 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 79aba108-cfd6-4e83-99f5-50403a500a87 is timed out.
Nov 07 15:42:05 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Successfully detached device vdc from instance 79aba108-cfd6-4e83-99f5-50403a500a87 from the live domain config.
Nov 07 15:42:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eoflpvAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:42:05 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:42:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b499a8d8-289f-48e3-8cc9-2b8ccd8b623c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:42:05 user nova-compute[75018]: No targets found.
Nov 07 15:42:05 user nova-compute[75018]: iSNS:
Nov 07 15:42:05 user nova-compute[75018]: No targets found.
Nov 07 15:42:05 user nova-compute[75018]: STATIC:
Nov 07 15:42:05 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce
Nov 07 15:42:05 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:42:05 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:42:05 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444
Nov 07 15:42:05 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:42:05 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:42:05 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee
Nov 07 15:42:05 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:42:05 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:42:05 user nova-compute[75018]: FIRMWARE:
Nov 07 15:42:05 user nova-compute[75018]: No targets found.
Nov 07 15:42:05 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:42:05 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:42:05 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f269cc-0f57-46cc-9c31-9673cefeb71c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e23b0a0-5bf2-4331-9a2d-7320a1110729]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:42:05 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:42:05 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:42:05 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:42:05 user nova-compute[75018]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce (non-flash)
Nov 07 15:42:05 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:42:05 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb001fa170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce'): ({'sde'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Removing single pathed devices sde {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0264cb-72ce-4ab0-9e89-299863ded319]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[294d2a64-8894-49ea-aea1-ef1018977d6e]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Flushing IO for device /dev/sde {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd78006-1385-4ee7-843d-4b03585f052a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:42:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[938b9a69-55ec-40c5-b04e-cfbab396d687]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] SCSI volumes sde have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92e78b2-a4d4-43fa-8b30-42470a792b27]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd31a5a-4872-47b8-83d0-4dbb82bf6d71]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce, portal: 172.16.0.220,3260]
Nov 07 15:42:06 user nova-compute[75018]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce, portal: 172.16.0.220,3260] successful.
Nov 07 15:42:06 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3272ec8e-ace6-4f5a-8e7c-2c56f1b3d7ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0689ca-f554-4b5c-a468-8a80a4159a47]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] <== disconnect_volume: return (286ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:42:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:42:07 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'flavor' on Instance uuid 79aba108-cfd6-4e83-99f5-50403a500a87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:42:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3ee3fb34-cffa-4cfa-93cf-a5dcfa310005 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.880s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:42:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:42:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:42:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:42:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:08 user nova-compute[75018]: INFO nova.compute.manager [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Terminating instance
Nov 07 15:42:08 user nova-compute[75018]: DEBUG nova.compute.manager [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-350a1404-010a-4033-b8a5-6265697030ee req-e8983fe4-b8af-47b8-ab22-cb73eda8a1fb service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received event network-vif-unplugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-350a1404-010a-4033-b8a5-6265697030ee req-e8983fe4-b8af-47b8-ab22-cb73eda8a1fb service nova] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-350a1404-010a-4033-b8a5-6265697030ee req-e8983fe4-b8af-47b8-ab22-cb73eda8a1fb service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-350a1404-010a-4033-b8a5-6265697030ee req-e8983fe4-b8af-47b8-ab22-cb73eda8a1fb service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-350a1404-010a-4033-b8a5-6265697030ee req-e8983fe4-b8af-47b8-ab22-cb73eda8a1fb service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] No waiting events found dispatching network-vif-unplugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-350a1404-010a-4033-b8a5-6265697030ee req-e8983fe4-b8af-47b8-ab22-cb73eda8a1fb service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received event network-vif-unplugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:08 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Instance destroyed successfully.
Nov 07 15:42:08 user nova-compute[75018]: DEBUG nova.objects.instance [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lazy-loading 'resources' on Instance uuid 79aba108-cfd6-4e83-99f5-50403a500a87 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1211350405',display_name='tempest-AttachVolumeTestJSON-server-1211350405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1211350405',id=33,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPQirCTSZkbnlG9q3vbm2c23iyeL4LTdNUFXqO3d1OARPNvRYAlG+nw4COIS3h42nzgeiQ1uBOT46/fJKjg5IC7rX07FGtM/eovzNT9CThtbgLPeBXrWMbokD6UMiKqmg==',key_name='tempest-keypair-217927639',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:38:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='393342d93e71462eba531f173860d59f',ramdisk_id='',reservation_id='r-si59g7p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1503001538',owner_user_name='tempest-AttachVolumeTestJSON-1503001538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:38:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8af061ec9b2444ecbbc2d1ef913fe558',uuid=79aba108-cfd6-4e83-99f5-50403a500a87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "address": "fa:16:3e:77:f2:a5", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ad0001-44", "ovs_interfaceid": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converting VIF {"id": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "address": "fa:16:3e:77:f2:a5", "network": {"id": "a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1042544710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "393342d93e71462eba531f173860d59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ad0001-44", "ovs_interfaceid": "16ad0001-44b6-47a4-a689-4a7cae768eb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=16ad0001-44b6-47a4-a689-4a7cae768eb3,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ad0001-44') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG os_vif [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=16ad0001-44b6-47a4-a689-4a7cae768eb3,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ad0001-44') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16ad0001-44, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cb1f063-1ee6-4bb2-b1b8-ee5caa2f082c) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:42:08 user nova-compute[75018]: INFO os_vif [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=16ad0001-44b6-47a4-a689-4a7cae768eb3,network=Network(a1e21852-a0e7-4f5d-a1f7-4c6ec4b94c71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ad0001-44')
Nov 07 15:42:08 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Deleting instance files /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87_del
Nov 07 15:42:08 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Deletion of /opt/stack/data/nova/instances/79aba108-cfd6-4e83-99f5-50403a500a87_del complete
Nov 07 15:42:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:09 user nova-compute[75018]: INFO nova.compute.manager [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 07 15:42:09 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:42:09 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:42:09 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:42:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:42:10 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Took 1.41 seconds to deallocate network for instance.
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received event network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] No waiting events found dispatching network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:42:10 user nova-compute[75018]: WARNING nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received unexpected event network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 for instance with vm_state active and task_state deleting.
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received event network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] No waiting events found dispatching network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:42:10 user nova-compute[75018]: WARNING nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received unexpected event network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 for instance with vm_state active and task_state deleting.
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received event network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] No waiting events found dispatching network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:42:10 user nova-compute[75018]: WARNING nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received unexpected event network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 for instance with vm_state active and task_state deleting.
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received event network-vif-unplugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] No waiting events found dispatching network-vif-unplugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received event network-vif-unplugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received event network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Acquiring lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] Lock "79aba108-cfd6-4e83-99f5-50403a500a87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] No waiting events found dispatching network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:42:10 user nova-compute[75018]: WARNING nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received unexpected event network-vif-plugged-16ad0001-44b6-47a4-a689-4a7cae768eb3 for instance with vm_state active and task_state deleting.
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-4276a1c4-cf38-41db-804f-f9f534fd9a8c req-b4f33917-a5d4-4a47-b94a-4360fac203c0 service nova] [instance: 79aba108-cfd6-4e83-99f5-50403a500a87] Received event network-vif-deleted-16ad0001-44b6-47a4-a689-4a7cae768eb3 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:10 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Deleted allocations for instance 79aba108-cfd6-4e83-99f5-50403a500a87
Nov 07 15:42:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bbdbeb42-573f-4f50-9d8e-b74b8b437990 tempest-AttachVolumeTestJSON-1503001538 tempest-AttachVolumeTestJSON-1503001538-project-member] Lock "79aba108-cfd6-4e83-99f5-50403a500a87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.824s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:42:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:42:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:42:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:42:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-c4a0d239-00fd-4b85-a236-23620930f537 req-699feb9f-9627-400e-97ee-19cc8d7a82ad service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Received event network-changed-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:42:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-c4a0d239-00fd-4b85-a236-23620930f537 req-699feb9f-9627-400e-97ee-19cc8d7a82ad service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Refreshing instance network info cache due to event network-changed-d2a12c3d-09d4-4648-8ad3-11e5e77e2837. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:42:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c4a0d239-00fd-4b85-a236-23620930f537 req-699feb9f-9627-400e-97ee-19cc8d7a82ad service nova] Acquiring lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:42:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c4a0d239-00fd-4b85-a236-23620930f537 req-699feb9f-9627-400e-97ee-19cc8d7a82ad service nova] Acquired lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:42:20 user nova-compute[75018]: DEBUG nova.network.neutron [req-c4a0d239-00fd-4b85-a236-23620930f537 req-699feb9f-9627-400e-97ee-19cc8d7a82ad service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Refreshing network info cache for port d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG nova.network.neutron [req-c4a0d239-00fd-4b85-a236-23620930f537 req-699feb9f-9627-400e-97ee-19cc8d7a82ad service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Updated VIF entry in instance network info cache for port d2a12c3d-09d4-4648-8ad3-11e5e77e2837. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG nova.network.neutron [req-c4a0d239-00fd-4b85-a236-23620930f537 req-699feb9f-9627-400e-97ee-19cc8d7a82ad service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Updating instance_info_cache with network_info: [{"id": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "address": "fa:16:3e:15:0a:74", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a12c3d-09", "ovs_interfaceid": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c4a0d239-00fd-4b85-a236-23620930f537 req-699feb9f-9627-400e-97ee-19cc8d7a82ad service nova] Releasing lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "7d054231-82b5-43b0-967a-78f5ef690090" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "7d054231-82b5-43b0-967a-78f5ef690090" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG nova.objects.instance [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lazy-loading 'flavor' on Instance uuid 7d054231-82b5-43b0-967a-78f5ef690090 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "7d054231-82b5-43b0-967a-78f5ef690090" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "7d054231-82b5-43b0-967a-78f5ef690090" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "7d054231-82b5-43b0-967a-78f5ef690090" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:21 user nova-compute[75018]: INFO nova.compute.manager [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Attaching volume a3a508a6-aa47-4a92-8c94-1dbb06bc0904 to /dev/vdb
Nov 07 15:42:21 user nova-compute[75018]: DEBUG os_brick.utils [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[97915881-4606-4e5b-8ca3-79bbb4c97410]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[55306299-5ae7-4349-83fe-f86aa55bbf39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cef1fe6-8293-4b04-a361-94a6e915f153]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e41d05-4815-466d-91d1-4a837fbf976a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:42:21 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:42:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e596d05-483f-4210-9c9f-01bbc07ec14c]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG os_brick.utils [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:42:21 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Updating existing volume attachment record: e9f88eb4-315a-4d80-bcdb-b148d7e25949 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:42:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:42:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:33 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:42:33 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:42:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:36 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:42:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:42:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:42:38 user nova-compute[75018]: DEBUG nova.compute.manager [req-9c214dee-dbb9-44cf-9439-5199d608cbac req-27a4139d-94ba-43d7-b06f-f09d5184eabd service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-changed-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:42:38 user nova-compute[75018]: DEBUG nova.compute.manager [req-9c214dee-dbb9-44cf-9439-5199d608cbac req-27a4139d-94ba-43d7-b06f-f09d5184eabd service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Refreshing instance network info cache due to event network-changed-280fe9e4-a375-4c55-adf5-babbe012ef3b. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:42:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9c214dee-dbb9-44cf-9439-5199d608cbac req-27a4139d-94ba-43d7-b06f-f09d5184eabd service nova] Acquiring lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:42:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9c214dee-dbb9-44cf-9439-5199d608cbac req-27a4139d-94ba-43d7-b06f-f09d5184eabd service nova] Acquired lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:42:38 user nova-compute[75018]: DEBUG nova.network.neutron [req-9c214dee-dbb9-44cf-9439-5199d608cbac req-27a4139d-94ba-43d7-b06f-f09d5184eabd service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Refreshing network info cache for port 280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:42:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:38 user nova-compute[75018]: INFO nova.compute.manager [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Detaching volume 28e9704f-2b83-4dbf-9311-216e4d9b1444
Nov 07 15:42:38 user nova-compute[75018]: INFO nova.virt.block_device [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Attempting to driver detach volume 28e9704f-2b83-4dbf-9311-216e4d9b1444 from mountpoint /dev/vdb
Nov 07 15:42:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Attempting to detach device vdb from instance e4ad018d-bdc7-458b-9e77-ba31457e52ff from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:42:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:42:38 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:42:38 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:42:38 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:42:38 user nova-compute[75018]:   <serial>28e9704f-2b83-4dbf-9311-216e4d9b1444</serial>
Nov 07 15:42:38 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:42:38 user nova-compute[75018]: </disk>
Nov 07 15:42:38 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:42:38 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Successfully detached device vdb from instance e4ad018d-bdc7-458b-9e77-ba31457e52ff from the persistent domain config.
Nov 07 15:42:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4ad018d-bdc7-458b-9e77-ba31457e52ff from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:42:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:42:38 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:42:38 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:42:38 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:42:38 user nova-compute[75018]:   <serial>28e9704f-2b83-4dbf-9311-216e4d9b1444</serial>
Nov 07 15:42:38 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:42:38 user nova-compute[75018]: </disk>
Nov 07 15:42:38 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:42:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:39 user nova-compute[75018]: DEBUG nova.network.neutron [req-9c214dee-dbb9-44cf-9439-5199d608cbac req-27a4139d-94ba-43d7-b06f-f09d5184eabd service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updated VIF entry in instance network info cache for port 280fe9e4-a375-4c55-adf5-babbe012ef3b. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:42:39 user nova-compute[75018]: DEBUG nova.network.neutron [req-9c214dee-dbb9-44cf-9439-5199d608cbac req-27a4139d-94ba-43d7-b06f-f09d5184eabd service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updating instance_info_cache with network_info: [{"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:42:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9c214dee-dbb9-44cf-9439-5199d608cbac req-27a4139d-94ba-43d7-b06f-f09d5184eabd service nova] Releasing lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:42:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4ad018d-bdc7-458b-9e77-ba31457e52ff {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:42:39 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:42:39 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:42:39 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 15:42:40 user nova-compute[75018]: DEBUG nova.compute.manager [req-5661415a-6dab-491d-849c-b23c721e782b req-4891ddc9-b62f-4a27-a906-bcff8db2e506 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-changed-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:42:40 user nova-compute[75018]: DEBUG nova.compute.manager [req-5661415a-6dab-491d-849c-b23c721e782b req-4891ddc9-b62f-4a27-a906-bcff8db2e506 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Refreshing instance network info cache due to event network-changed-280fe9e4-a375-4c55-adf5-babbe012ef3b. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:42:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5661415a-6dab-491d-849c-b23c721e782b req-4891ddc9-b62f-4a27-a906-bcff8db2e506 service nova] Acquiring lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:42:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5661415a-6dab-491d-849c-b23c721e782b req-4891ddc9-b62f-4a27-a906-bcff8db2e506 service nova] Acquired lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:42:40 user nova-compute[75018]: DEBUG nova.network.neutron [req-5661415a-6dab-491d-849c-b23c721e782b req-4891ddc9-b62f-4a27-a906-bcff8db2e506 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Refreshing network info cache for port 280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:42:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:41 user nova-compute[75018]: DEBUG nova.network.neutron [req-5661415a-6dab-491d-849c-b23c721e782b req-4891ddc9-b62f-4a27-a906-bcff8db2e506 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updated VIF entry in instance network info cache for port 280fe9e4-a375-4c55-adf5-babbe012ef3b. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:42:41 user nova-compute[75018]: DEBUG nova.network.neutron [req-5661415a-6dab-491d-849c-b23c721e782b req-4891ddc9-b62f-4a27-a906-bcff8db2e506 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updating instance_info_cache with network_info: [{"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:42:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5661415a-6dab-491d-849c-b23c721e782b req-4891ddc9-b62f-4a27-a906-bcff8db2e506 service nova] Releasing lock "refresh_cache-e4ad018d-bdc7-458b-9e77-ba31457e52ff" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:42:42 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:42:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:42 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:42:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:42:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Going to confirm migration 2 {{(pid=75018) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquired lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lazy-loading 'info_cache' on Instance uuid da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:43 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Updating instance_info_cache with network_info: [{"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Releasing lock "refresh_cache-da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lazy-loading 'migration_context' on Instance uuid da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG nova.objects.base [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Object Instance<da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb> lazy-loaded attributes: info_cache,migration_context {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.551s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:44 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Deleted allocation for migration 186d34d9-58f3-462a-9aff-bb7fb3631d98
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a3ce160f-4cd7-4830-a42d-60272d0c8078 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.869s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GaXOjrpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:42:45 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:42:45 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:42:45 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[caad2cfb-a4d2-4b3b-8972-d2e0a5f36e71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:42:45 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[de703169-115b-47ca-b766-76a66006baa2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904] added
Nov 07 15:42:45 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6dcc94-4dfb-4bc9-8aff-6c95039f34e3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f659f16-a9ba-4bba-a632-289d61ee2b21]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GaXOjrpz {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GaXOjrpz" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5d5041-b1da-41b8-9a50-12c6d81abe18]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GaXOjrpz'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e40a6a-fceb-43e6-82ec-0e97259d50ce]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54c34eb-e14d-431b-b561-0e1f843ec691]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:42:45 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:42:45 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:42:45 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:42:45 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec4c016-91b9-4aa6-a31a-45fca650827e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904, portal: 172.16.0.220,3260]
Nov 07 15:42:45 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904, portal: 172.16.0.220,3260] successful.
Nov 07 15:42:45 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec157a3b-9e33-4aff-a6b2-feb5a93b3a4d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[96861a42-4d8a-4495-8f0f-c4db5704fcc2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:42:46 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:42:46 user nova-compute[75018]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 (non-flash)
Nov 07 15:42:46 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:42:46 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:42:46 user nova-compute[75018]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 (non-flash)
Nov 07 15:42:46 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.755s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:46 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:42:46 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:42:46 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8054MB free_disk=25.10019302368164GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4955cb34-1423-4c83-ae26-eb064c7ebf59]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GaXOjrpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e4ad018d-bdc7-458b-9e77-ba31457e52ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 7d054231-82b5-43b0-967a-78f5ef690090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:42:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.809s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:42:47 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] <== connect_volume: return (1812ms) {'type': 'block', 'scsi_wwn': '23135396530653234', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:42:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135396530653234', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:42:47 user nova-compute[75018]: DEBUG nova.objects.instance [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lazy-loading 'flavor' on Instance uuid 7d054231-82b5-43b0-967a-78f5ef690090 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:42:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:42:47 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:42:47 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 15:42:47 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:42:47 user nova-compute[75018]:   <serial>a3a508a6-aa47-4a92-8c94-1dbb06bc0904</serial>
Nov 07 15:42:47 user nova-compute[75018]: </disk>
Nov 07 15:42:47 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:42:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:42:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:42:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] No VIF found with MAC fa:16:3e:15:0a:74, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:42:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:42:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:42:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b8273b10-db67-4269-97f2-910b4ba3d5ec tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "7d054231-82b5-43b0-967a-78f5ef690090" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.384s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:42:48 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:42:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "7d054231-82b5-43b0-967a-78f5ef690090" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:42:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "7d054231-82b5-43b0-967a-78f5ef690090" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:42:50 user nova-compute[75018]: INFO nova.compute.manager [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Detaching volume a3a508a6-aa47-4a92-8c94-1dbb06bc0904
Nov 07 15:42:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:50 user nova-compute[75018]: INFO nova.virt.block_device [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Attempting to driver detach volume a3a508a6-aa47-4a92-8c94-1dbb06bc0904 from mountpoint /dev/vdb
Nov 07 15:42:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Attempting to detach device vdb from instance 7d054231-82b5-43b0-967a-78f5ef690090 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:42:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:42:50 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:42:50 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 15:42:50 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:42:50 user nova-compute[75018]:   <serial>a3a508a6-aa47-4a92-8c94-1dbb06bc0904</serial>
Nov 07 15:42:50 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:42:50 user nova-compute[75018]: </disk>
Nov 07 15:42:50 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:42:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Successfully detached device vdb from instance 7d054231-82b5-43b0-967a-78f5ef690090 from the persistent domain config.
Nov 07 15:42:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d054231-82b5-43b0-967a-78f5ef690090 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:42:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:42:50 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:42:50 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 15:42:50 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:42:50 user nova-compute[75018]:   <serial>a3a508a6-aa47-4a92-8c94-1dbb06bc0904</serial>
Nov 07 15:42:50 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:42:50 user nova-compute[75018]: </disk>
Nov 07 15:42:50 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:42:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d054231-82b5-43b0-967a-78f5ef690090 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:42:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:42:59 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e4ad018d-bdc7-458b-9e77-ba31457e52ff is timed out.
Nov 07 15:42:59 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Successfully detached device vdb from instance e4ad018d-bdc7-458b-9e77-ba31457e52ff from the live domain config.
Nov 07 15:42:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUTWPgsF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:42:59 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd41ca9-4065-4118-ba7a-3484d7974d43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:42:59 user nova-compute[75018]: No targets found.
Nov 07 15:42:59 user nova-compute[75018]: iSNS:
Nov 07 15:42:59 user nova-compute[75018]: No targets found.
Nov 07 15:42:59 user nova-compute[75018]: STATIC:
Nov 07 15:42:59 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444
Nov 07 15:42:59 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:42:59 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:42:59 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904
Nov 07 15:42:59 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:42:59 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:42:59 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee
Nov 07 15:42:59 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:42:59 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:42:59 user nova-compute[75018]: FIRMWARE:
Nov 07 15:42:59 user nova-compute[75018]: No targets found.
Nov 07 15:42:59 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:42:59 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:42:59 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13570c9-2081-4973-a472-90313e609e67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43bcf5e-f131-4a51-8990-b5ca1a8d4448]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:42:59 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:42:59 user nova-compute[75018]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 (non-flash)
Nov 07 15:42:59 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 (non-flash)
Nov 07 15:42:59 user nova-compute[75018]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:42:59 user nova-compute[75018]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 (non-flash)
Nov 07 15:42:59 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae055f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444'): ({'sdc'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Removing single pathed devices sdc {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61fd91b-69e6-4d19-a42d-8621199a4e73]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a4ab17-613a-4d94-a2cb-be854fd46532]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Flushing IO for device /dev/sdc {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c354919-ce7d-4db3-bda9-c6adbde62f3e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[83756141-ee13-4e9b-97a2-5da352281cc8]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfb91db-5a8b-4e23-9c82-338dd4dd31d3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0361b6-a96b-4d80-a22e-3450d63ef356]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444, portal: 172.16.0.220,3260]
Nov 07 15:42:59 user nova-compute[75018]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444, portal: 172.16.0.220,3260] successful.
Nov 07 15:42:59 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e9704f-2b83-4dbf-9311-216e4d9b1444 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7611f5b4-55ae-4584-bae9-fa67c39061ca]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] <== disconnect_volume: return (330ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:42:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:43:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:43:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:43:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:43:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:43:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "488821ee-b1f3-4ae2-af06-739901164a6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "488821ee-b1f3-4ae2-af06-739901164a6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:43:06 user nova-compute[75018]: INFO nova.compute.claims [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Claim successful on node user
Nov 07 15:43:06 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG nova.network.neutron [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:43:06 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:43:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG nova.policy [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ae23950e1e84c9693f8098c270ecb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772e759d9a1d4d18ae43f53c731f87f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:43:06 user nova-compute[75018]: INFO nova.virt.block_device [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Booting with volume d8788460-9f20-4a53-b870-42b87b947f24 at /dev/vda
Nov 07 15:43:06 user nova-compute[75018]: DEBUG os_brick.utils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbb29d2-5952-4a0a-bd02-7957ab1fb70e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[953cb651-40a6-43eb-81a6-fd8d9805ac1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02f2ace-7d3f-4bae-9977-ae398d7a00d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66b9bf2-cd83-4db1-b0fc-11c44c6f5d73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:43:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:43:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:43:07 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:43:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[425f6ac9-1637-4bc9-a633-c179609afc8f]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:43:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:43:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:43:07 user nova-compute[75018]: DEBUG os_brick.utils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:43:07 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Updating existing volume attachment record: 45d38042-95f4-4b45-80a4-aac9d87e5e66 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:43:08 user nova-compute[75018]: DEBUG nova.network.neutron [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Successfully created port: cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:43:08 user nova-compute[75018]: DEBUG nova.network.neutron [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Successfully updated port: cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:43:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "refresh_cache-488821ee-b1f3-4ae2-af06-739901164a6f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:43:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquired lock "refresh_cache-488821ee-b1f3-4ae2-af06-739901164a6f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:43:08 user nova-compute[75018]: DEBUG nova.network.neutron [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:43:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-1114a7d0-fd8d-4734-9453-4b6782f064d2 req-e725f6bc-459a-455f-9ef8-aa75cf958775 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Received event network-changed-cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:43:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-1114a7d0-fd8d-4734-9453-4b6782f064d2 req-e725f6bc-459a-455f-9ef8-aa75cf958775 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Refreshing instance network info cache due to event network-changed-cb2849e4-1360-44fe-aae7-c0fececd0cfa. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:43:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1114a7d0-fd8d-4734-9453-4b6782f064d2 req-e725f6bc-459a-455f-9ef8-aa75cf958775 service nova] Acquiring lock "refresh_cache-488821ee-b1f3-4ae2-af06-739901164a6f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:43:08 user nova-compute[75018]: DEBUG nova.network.neutron [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:43:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:09 user nova-compute[75018]: DEBUG nova.network.neutron [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Updating instance_info_cache with network_info: [{"id": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "address": "fa:16:3e:5b:9c:07", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2849e4-13", "ovs_interfaceid": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:43:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Releasing lock "refresh_cache-488821ee-b1f3-4ae2-af06-739901164a6f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:43:09 user nova-compute[75018]: DEBUG nova.compute.manager [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Instance network_info: |[{"id": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "address": "fa:16:3e:5b:9c:07", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2849e4-13", "ovs_interfaceid": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:43:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1114a7d0-fd8d-4734-9453-4b6782f064d2 req-e725f6bc-459a-455f-9ef8-aa75cf958775 service nova] Acquired lock "refresh_cache-488821ee-b1f3-4ae2-af06-739901164a6f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:43:09 user nova-compute[75018]: DEBUG nova.network.neutron [req-1114a7d0-fd8d-4734-9453-4b6782f064d2 req-e725f6bc-459a-455f-9ef8-aa75cf958775 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Refreshing network info cache for port cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:43:09 user nova-compute[75018]: DEBUG nova.network.neutron [req-1114a7d0-fd8d-4734-9453-4b6782f064d2 req-e725f6bc-459a-455f-9ef8-aa75cf958775 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Updated VIF entry in instance network info cache for port cb2849e4-1360-44fe-aae7-c0fececd0cfa. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:43:09 user nova-compute[75018]: DEBUG nova.network.neutron [req-1114a7d0-fd8d-4734-9453-4b6782f064d2 req-e725f6bc-459a-455f-9ef8-aa75cf958775 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Updating instance_info_cache with network_info: [{"id": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "address": "fa:16:3e:5b:9c:07", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2849e4-13", "ovs_interfaceid": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:43:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1114a7d0-fd8d-4734-9453-4b6782f064d2 req-e725f6bc-459a-455f-9ef8-aa75cf958775 service nova] Releasing lock "refresh_cache-488821ee-b1f3-4ae2-af06-739901164a6f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:43:10 user nova-compute[75018]: DEBUG nova.objects.instance [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'flavor' on Instance uuid e4ad018d-bdc7-458b-9e77-ba31457e52ff {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-40b83bb4-b59c-4e63-ae1c-78587bd97616 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.387s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:11 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7d054231-82b5-43b0-967a-78f5ef690090 is timed out.
Nov 07 15:43:11 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Successfully detached device vdb from instance 7d054231-82b5-43b0-967a-78f5ef690090 from the live domain config.
Nov 07 15:43:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GaXOjrpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:43:11 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b50df3-c739-49cf-b35e-2c597f386404]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:43:11 user nova-compute[75018]: No targets found.
Nov 07 15:43:11 user nova-compute[75018]: iSNS:
Nov 07 15:43:11 user nova-compute[75018]: No targets found.
Nov 07 15:43:11 user nova-compute[75018]: STATIC:
Nov 07 15:43:11 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904
Nov 07 15:43:11 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:43:11 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:43:11 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee
Nov 07 15:43:11 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:43:11 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:43:11 user nova-compute[75018]: FIRMWARE:
Nov 07 15:43:11 user nova-compute[75018]: No targets found.
Nov 07 15:43:11 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:43:11 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:43:11 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b09d88-a260-47ab-b91a-75c30868052c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1885566b-2b78-4a1a-bbc8-f6decd5abcdb]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:43:11 user nova-compute[75018]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 (non-flash)
Nov 07 15:43:11 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:43:11 user nova-compute[75018]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 (non-flash)
Nov 07 15:43:11 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae0333c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6726c633-8d4f-4f0b-89ec-59431fe25b81]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8855a9c3-ad5f-47e4-a968-d84660b62c14]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffeb70e-8964-4942-9c51-21636a60cdd8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf52a09-fcca-48ef-a7c4-dd01aec6803e]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edf3bd2-6d98-4aa4-8f0f-14bcf39e5a16]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd9a7ee-ca7a-4ec4-8ded-c4a3ca61877b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904, portal: 172.16.0.220,3260]
Nov 07 15:43:11 user nova-compute[75018]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904, portal: 172.16.0.220,3260] successful.
Nov 07 15:43:11 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a508a6-aa47-4a92-8c94-1dbb06bc0904 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8bfeb9-09a9-47d9-903b-ad96e6b41b7c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] <== disconnect_volume: return (322ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "1013f68f-ef99-4544-a3ce-d5f731b41606" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:43:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:43:11 user nova-compute[75018]: INFO nova.compute.claims [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Claim successful on node user
Nov 07 15:43:12 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:43:12 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:43:12 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:43:12 user nova-compute[75018]: INFO nova.virt.block_device [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Booting with volume 94213c4a-0df9-472e-9256-187bbe0d8c89 at /dev/vda
Nov 07 15:43:12 user nova-compute[75018]: DEBUG nova.policy [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '078ecf188a31491c9841224829899661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f296caee0c4c87acaf64774de69cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG os_brick.utils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b74918-f39e-482b-8df9-7d42453e12c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df06d95-90e8-4d97-b996-3b74877d8d4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7811e14b-40ac-4a4a-8984-5be6d9675d6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada648a7-51a3-4fb5-8b6e-9ef7d882e474]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:43:12 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:43:12 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a8d729-097d-4e8d-8720-983f0bad60f1]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG os_brick.utils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:43:12 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updating existing volume attachment record: 692f59f1-7c17-4fd4-800e-f418c366c484 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:43:13 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Successfully created port: 74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:43:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:14 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Successfully updated port: 74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:43:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:43:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquired lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:43:14 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:43:14 user nova-compute[75018]: DEBUG nova.compute.manager [req-928377af-e377-40ba-9a52-2cc6940c9c91 req-6539c209-b31b-47c2-9841-04afd5871f45 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-changed-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:43:14 user nova-compute[75018]: DEBUG nova.compute.manager [req-928377af-e377-40ba-9a52-2cc6940c9c91 req-6539c209-b31b-47c2-9841-04afd5871f45 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Refreshing instance network info cache due to event network-changed-74fe6639-8825-4ac6-ad52-3c5a6773857f. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:43:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-928377af-e377-40ba-9a52-2cc6940c9c91 req-6539c209-b31b-47c2-9841-04afd5871f45 service nova] Acquiring lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:43:14 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:43:14 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updating instance_info_cache with network_info: [{"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:43:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Releasing lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:43:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Instance network_info: |[{"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:43:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-928377af-e377-40ba-9a52-2cc6940c9c91 req-6539c209-b31b-47c2-9841-04afd5871f45 service nova] Acquired lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:43:14 user nova-compute[75018]: DEBUG nova.network.neutron [req-928377af-e377-40ba-9a52-2cc6940c9c91 req-6539c209-b31b-47c2-9841-04afd5871f45 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Refreshing network info cache for port 74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:43:15 user nova-compute[75018]: DEBUG nova.network.neutron [req-928377af-e377-40ba-9a52-2cc6940c9c91 req-6539c209-b31b-47c2-9841-04afd5871f45 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updated VIF entry in instance network info cache for port 74fe6639-8825-4ac6-ad52-3c5a6773857f. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:43:15 user nova-compute[75018]: DEBUG nova.network.neutron [req-928377af-e377-40ba-9a52-2cc6940c9c91 req-6539c209-b31b-47c2-9841-04afd5871f45 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updating instance_info_cache with network_info: [{"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:43:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-928377af-e377-40ba-9a52-2cc6940c9c91 req-6539c209-b31b-47c2-9841-04afd5871f45 service nova] Releasing lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:43:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:23 user nova-compute[75018]: DEBUG nova.objects.instance [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lazy-loading 'flavor' on Instance uuid 7d054231-82b5-43b0-967a-78f5ef690090 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:43:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-2b4bbb2c-5bee-4e57-b615-7ce070089827 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "7d054231-82b5-43b0-967a-78f5ef690090" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.823s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:29 user nova-compute[75018]: INFO nova.compute.manager [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Terminating instance
Nov 07 15:43:29 user nova-compute[75018]: DEBUG nova.compute.manager [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:29 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Instance destroyed successfully.
Nov 07 15:43:29 user nova-compute[75018]: DEBUG nova.objects.instance [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'resources' on Instance uuid e4ad018d-bdc7-458b-9e77-ba31457e52ff {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:36:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-383028183',display_name='tempest-ServerRescueNegativeTestJSON-server-383028183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-383028183',id=28,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXlVLFR1auiipSprdX96rkwHLVObqrWok4UB8xbGBLwxbV3XoGdfCwIP9llsZoGGWjO60XbhFNifEi5pPhV3RvNdDG0ZBk1XRXIWWyz6JGQQrqGIsByOItviiS/2raJrA==',key_name='tempest-keypair-1034588000',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:39:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374a202b7d114f009ac374762e08c364',ramdisk_id='',reservation_id='r-x55em1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1476352427',owner_user_name='tempest-ServerRescueNegativeTestJSON-1476352427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:40:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='869a94fcb52246d583be8bac4a722a3c',uuid=e4ad018d-bdc7-458b-9e77-ba31457e52ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converting VIF {"id": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "address": "fa:16:3e:a7:84:70", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280fe9e4-a3", "ovs_interfaceid": "280fe9e4-a375-4c55-adf5-babbe012ef3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:84:70,bridge_name='br-int',has_traffic_filtering=True,id=280fe9e4-a375-4c55-adf5-babbe012ef3b,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280fe9e4-a3') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG os_vif [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:84:70,bridge_name='br-int',has_traffic_filtering=True,id=280fe9e4-a375-4c55-adf5-babbe012ef3b,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280fe9e4-a3') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap280fe9e4-a3, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b14e9ef6-0299-463b-984a-c8e1fc0e775c) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:43:29 user nova-compute[75018]: INFO os_vif [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:84:70,bridge_name='br-int',has_traffic_filtering=True,id=280fe9e4-a375-4c55-adf5-babbe012ef3b,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280fe9e4-a3')
Nov 07 15:43:29 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Deleting instance files /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff_del
Nov 07 15:43:29 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Deletion of /opt/stack/data/nova/instances/e4ad018d-bdc7-458b-9e77-ba31457e52ff_del complete
Nov 07 15:43:29 user nova-compute[75018]: INFO nova.compute.manager [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 07 15:43:29 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:43:29 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:43:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-3d71766a-6f96-423b-bc51-847e6438c9bd req-0386f994-ef85-45cb-b7f4-987773fd7b1c service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-vif-unplugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:43:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3d71766a-6f96-423b-bc51-847e6438c9bd req-0386f994-ef85-45cb-b7f4-987773fd7b1c service nova] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:43:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3d71766a-6f96-423b-bc51-847e6438c9bd req-0386f994-ef85-45cb-b7f4-987773fd7b1c service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:43:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3d71766a-6f96-423b-bc51-847e6438c9bd req-0386f994-ef85-45cb-b7f4-987773fd7b1c service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-3d71766a-6f96-423b-bc51-847e6438c9bd req-0386f994-ef85-45cb-b7f4-987773fd7b1c service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] No waiting events found dispatching network-vif-unplugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:43:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-3d71766a-6f96-423b-bc51-847e6438c9bd req-0386f994-ef85-45cb-b7f4-987773fd7b1c service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-vif-unplugged-280fe9e4-a375-4c55-adf5-babbe012ef3b for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:43:30 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:43:30 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Took 0.89 seconds to deallocate network for instance.
Nov 07 15:43:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-1c521d63-7b5b-4444-9f10-e4e028baffa7 req-01315c37-0f6f-4d0c-8864-4c81479f447e service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-vif-deleted-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:43:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:43:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:43:31 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:43:31 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:43:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:31 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Deleted allocations for instance e4ad018d-bdc7-458b-9e77-ba31457e52ff
Nov 07 15:43:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6478e0dd-483f-410b-abbb-bd14de962d7d tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.396s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:43:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-caa185a9-2135-4387-b7cc-28e1142205d2 req-4a805c79-46a1-46ed-8a63-11b5738d2d10 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:43:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-caa185a9-2135-4387-b7cc-28e1142205d2 req-4a805c79-46a1-46ed-8a63-11b5738d2d10 service nova] Acquiring lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:43:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-caa185a9-2135-4387-b7cc-28e1142205d2 req-4a805c79-46a1-46ed-8a63-11b5738d2d10 service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:43:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-caa185a9-2135-4387-b7cc-28e1142205d2 req-4a805c79-46a1-46ed-8a63-11b5738d2d10 service nova] Lock "e4ad018d-bdc7-458b-9e77-ba31457e52ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-caa185a9-2135-4387-b7cc-28e1142205d2 req-4a805c79-46a1-46ed-8a63-11b5738d2d10 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] No waiting events found dispatching network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:43:32 user nova-compute[75018]: WARNING nova.compute.manager [req-caa185a9-2135-4387-b7cc-28e1142205d2 req-4a805c79-46a1-46ed-8a63-11b5738d2d10 service nova] [instance: e4ad018d-bdc7-458b-9e77-ba31457e52ff] Received unexpected event network-vif-plugged-280fe9e4-a375-4c55-adf5-babbe012ef3b for instance with vm_state deleted and task_state None.
Nov 07 15:43:34 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:43:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:43:35 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Creating image(s)
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Did not create local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Ensure instance console log exists: /opt/stack/data/nova/instances/1013f68f-ef99-4544-a3ce-d5f731b41606/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Start _get_guest_xml network_info=[{"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgnlWfCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1013f68f-ef99-4544-a3ce-d5f731b41606', 'attached_at': '', 'detached_at': '', 'volume_id': '94213c4a-0df9-472e-9256-187bbe0d8c89', 'serial': '94213c4a-0df9-472e-9256-187bbe0d8c89'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '692f59f1-7c17-4fd4-800e-f418c366c484', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:43:35 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:43:35 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:43:35 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgnlWfCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:43:36 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:43:36 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:43:36 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[25832fac-1550-41d0-8694-137224822594]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:43:36 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0399c1-b012-4f17-87b3-94ea3dccb514]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89] added
Nov 07 15:43:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c727d234-9681-4a33-ac79-cde1270927be]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0bf813-89d6-4b54-970e-a05bf8e22df6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgnlWfCQ {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgnlWfCQ" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5a0fa5-31e0-4149-8ab7-066e5803fea1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VgnlWfCQ'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cafcfa5-ebc2-44c9-9ff1-69a9eb863f40]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee29fe0-bfaf-4240-86b9-fd9e9150c64b]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:43:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:43:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[450fa012-9cce-4e2b-8483-40705f7c0b4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260]
Nov 07 15:43:36 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260] successful.
Nov 07 15:43:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43ed174-81be-4471-bf21-e3d9e388ca35]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7f1e3b-fd57-4243-b99a-1488214aed16]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:43:36 user nova-compute[75018]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:43:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:43:36 user nova-compute[75018]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:43:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcad7da6-f137-42eb-9b87-637f4b0db768]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:43:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgnlWfCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23161353530643964', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161353530643964', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-465451204',display_name='tempest-TestShelveInstance-server-465451204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-465451204',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuVrEFrwEj6OeOOAGIW8mZfqkBlLHl15boYTLN4+rcHDOhOesO3XWH7Ay0ZCO8ZExQ4Qyy6ptmZx4rXdAah8ySoRuw/DOtcmuwWoHoxlfWmN131iGvvcoSdfQFQfrQe3A==',key_name='tempest-TestShelveInstance-486488334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0f296caee0c4c87acaf64774de69cfb',ramdisk_id='',reservation_id='r-p7bfb4yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1838376973',owner_user_name='tempest-TestShelveInstance-1838376973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:43:13Z,user_data=None,user_id='078ecf188a31491c9841224829899661',uuid=1013f68f-ef99-4544-a3ce-d5f731b41606,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Converting VIF {"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=74fe6639-8825-4ac6-ad52-3c5a6773857f,network=Network(1ec84201-4506-4c97-8ea5-9536271fb4f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fe6639-88') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG nova.objects.instance [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lazy-loading 'pci_devices' on Instance uuid 1013f68f-ef99-4544-a3ce-d5f731b41606 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:43:37 user nova-compute[75018]:   <uuid>1013f68f-ef99-4544-a3ce-d5f731b41606</uuid>
Nov 07 15:43:37 user nova-compute[75018]:   <name>instance-00000026</name>
Nov 07 15:43:37 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:43:37 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:43:37 user nova-compute[75018]:   <metadata>
Nov 07 15:43:37 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:43:37 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:43:37 user nova-compute[75018]:       <nova:name>tempest-TestShelveInstance-server-465451204</nova:name>
Nov 07 15:43:37 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:43:35</nova:creationTime>
Nov 07 15:43:37 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:43:37 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:43:37 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:43:37 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:43:37 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:43:37 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:43:37 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:43:37 user nova-compute[75018]:       <nova:owner>
Nov 07 15:43:37 user nova-compute[75018]:         <nova:user uuid="078ecf188a31491c9841224829899661">tempest-TestShelveInstance-1838376973-project-member</nova:user>
Nov 07 15:43:37 user nova-compute[75018]:         <nova:project uuid="e0f296caee0c4c87acaf64774de69cfb">tempest-TestShelveInstance-1838376973</nova:project>
Nov 07 15:43:37 user nova-compute[75018]:       </nova:owner>
Nov 07 15:43:37 user nova-compute[75018]:       <nova:ports>
Nov 07 15:43:37 user nova-compute[75018]:         <nova:port uuid="74fe6639-8825-4ac6-ad52-3c5a6773857f">
Nov 07 15:43:37 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 07 15:43:37 user nova-compute[75018]:         </nova:port>
Nov 07 15:43:37 user nova-compute[75018]:       </nova:ports>
Nov 07 15:43:37 user nova-compute[75018]:     </nova:instance>
Nov 07 15:43:37 user nova-compute[75018]:   </metadata>
Nov 07 15:43:37 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:43:37 user nova-compute[75018]:     <system>
Nov 07 15:43:37 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:43:37 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:43:37 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:43:37 user nova-compute[75018]:       <entry name="serial">1013f68f-ef99-4544-a3ce-d5f731b41606</entry>
Nov 07 15:43:37 user nova-compute[75018]:       <entry name="uuid">1013f68f-ef99-4544-a3ce-d5f731b41606</entry>
Nov 07 15:43:37 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:43:37 user nova-compute[75018]:     </system>
Nov 07 15:43:37 user nova-compute[75018]:   </sysinfo>
Nov 07 15:43:37 user nova-compute[75018]:   <os>
Nov 07 15:43:37 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:43:37 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:43:37 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:43:37 user nova-compute[75018]:   </os>
Nov 07 15:43:37 user nova-compute[75018]:   <features>
Nov 07 15:43:37 user nova-compute[75018]:     <acpi/>
Nov 07 15:43:37 user nova-compute[75018]:     <apic/>
Nov 07 15:43:37 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:43:37 user nova-compute[75018]:   </features>
Nov 07 15:43:37 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:43:37 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:43:37 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:43:37 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:43:37 user nova-compute[75018]:   </clock>
Nov 07 15:43:37 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:43:37 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:43:37 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:43:37 user nova-compute[75018]:   </cpu>
Nov 07 15:43:37 user nova-compute[75018]:   <devices>
Nov 07 15:43:37 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:43:37 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:43:37 user nova-compute[75018]:       <source dev="/dev/sdb"/>
Nov 07 15:43:37 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:43:37 user nova-compute[75018]:       <serial>94213c4a-0df9-472e-9256-187bbe0d8c89</serial>
Nov 07 15:43:37 user nova-compute[75018]:     </disk>
Nov 07 15:43:37 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:43:37 user nova-compute[75018]:       <mac address="fa:16:3e:66:6d:4b"/>
Nov 07 15:43:37 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:43:37 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:43:37 user nova-compute[75018]:       <target dev="tap74fe6639-88"/>
Nov 07 15:43:37 user nova-compute[75018]:     </interface>
Nov 07 15:43:37 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:43:37 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/1013f68f-ef99-4544-a3ce-d5f731b41606/console.log" append="off"/>
Nov 07 15:43:37 user nova-compute[75018]:     </serial>
Nov 07 15:43:37 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:43:37 user nova-compute[75018]:     <video>
Nov 07 15:43:37 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:43:37 user nova-compute[75018]:     </video>
Nov 07 15:43:37 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:43:37 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:43:37 user nova-compute[75018]:     </rng>
Nov 07 15:43:37 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:43:37 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:43:37 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:43:37 user nova-compute[75018]:     </memballoon>
Nov 07 15:43:37 user nova-compute[75018]:   </devices>
Nov 07 15:43:37 user nova-compute[75018]: </domain>
Nov 07 15:43:37 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-465451204',display_name='tempest-TestShelveInstance-server-465451204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-465451204',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuVrEFrwEj6OeOOAGIW8mZfqkBlLHl15boYTLN4+rcHDOhOesO3XWH7Ay0ZCO8ZExQ4Qyy6ptmZx4rXdAah8ySoRuw/DOtcmuwWoHoxlfWmN131iGvvcoSdfQFQfrQe3A==',key_name='tempest-TestShelveInstance-486488334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0f296caee0c4c87acaf64774de69cfb',ramdisk_id='',reservation_id='r-p7bfb4yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1838376973',owner_user_name='tempest-TestShelveInstance-1838376973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:43:13Z,user_data=None,user_id='078ecf188a31491c9841224829899661',uuid=1013f68f-ef99-4544-a3ce-d5f731b41606,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Converting VIF {"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=74fe6639-8825-4ac6-ad52-3c5a6773857f,network=Network(1ec84201-4506-4c97-8ea5-9536271fb4f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fe6639-88') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG os_vif [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=74fe6639-8825-4ac6-ad52-3c5a6773857f,network=Network(1ec84201-4506-4c97-8ea5-9536271fb4f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fe6639-88') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e008820e-c500-5ca7-9b19-703e7c7e339b', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74fe6639-88, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74fe6639-88, col_values=(('qos', UUID('ef965756-bdd5-41f3-87a8-0af1da0e9905')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74fe6639-88, col_values=(('external_ids', {'iface-id': '74fe6639-8825-4ac6-ad52-3c5a6773857f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:6d:4b', 'vm-uuid': '1013f68f-ef99-4544-a3ce-d5f731b41606'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:37 user nova-compute[75018]: INFO os_vif [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=74fe6639-8825-4ac6-ad52-3c5a6773857f,network=Network(1ec84201-4506-4c97-8ea5-9536271fb4f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fe6639-88')
Nov 07 15:43:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] No VIF found with MAC fa:16:3e:66:6d:4b, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:43:37 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:43:38 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:43:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-fb1313f2-832b-4418-9f78-70a094daa2d4 req-104a9b6c-d621-4f7a-918d-fc24ab7b373d service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:43:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fb1313f2-832b-4418-9f78-70a094daa2d4 req-104a9b6c-d621-4f7a-918d-fc24ab7b373d service nova] Acquiring lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:43:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fb1313f2-832b-4418-9f78-70a094daa2d4 req-104a9b6c-d621-4f7a-918d-fc24ab7b373d service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:43:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fb1313f2-832b-4418-9f78-70a094daa2d4 req-104a9b6c-d621-4f7a-918d-fc24ab7b373d service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-fb1313f2-832b-4418-9f78-70a094daa2d4 req-104a9b6c-d621-4f7a-918d-fc24ab7b373d service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] No waiting events found dispatching network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:43:39 user nova-compute[75018]: WARNING nova.compute.manager [req-fb1313f2-832b-4418-9f78-70a094daa2d4 req-104a9b6c-d621-4f7a-918d-fc24ab7b373d service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received unexpected event network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f for instance with vm_state building and task_state spawning.
Nov 07 15:43:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:40 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:43:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:43:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 15:43:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Skipping network cache update for instance because it is Building. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 07 15:43:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Skipping network cache update for instance because it is Building. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 07 15:43:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:43:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:43:40 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:43:40 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid 0e508411-09db-48b8-98a5-1ccd9f4f6031 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:43:41 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Instance spawned successfully.
Nov 07 15:43:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:41 user nova-compute[75018]: INFO nova.compute.manager [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 07 15:43:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG nova.compute.manager [req-bd35133e-765e-425b-86b2-285633d61237 req-dd816fc7-4786-46f3-a516-538b5ad4854b service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-bd35133e-765e-425b-86b2-285633d61237 req-dd816fc7-4786-46f3-a516-538b5ad4854b service nova] Acquiring lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-bd35133e-765e-425b-86b2-285633d61237 req-dd816fc7-4786-46f3-a516-538b5ad4854b service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-bd35133e-765e-425b-86b2-285633d61237 req-dd816fc7-4786-46f3-a516-538b5ad4854b service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG nova.compute.manager [req-bd35133e-765e-425b-86b2-285633d61237 req-dd816fc7-4786-46f3-a516-538b5ad4854b service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] No waiting events found dispatching network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:43:41 user nova-compute[75018]: WARNING nova.compute.manager [req-bd35133e-765e-425b-86b2-285633d61237 req-dd816fc7-4786-46f3-a516-538b5ad4854b service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received unexpected event network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f for instance with vm_state building and task_state spawning.
Nov 07 15:43:41 user nova-compute[75018]: INFO nova.compute.manager [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Took 29.34 seconds to build instance.
Nov 07 15:43:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updating instance_info_cache with network_info: [{"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5f754362-a54b-4506-baac-e6ffc57935a0 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.448s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-0e508411-09db-48b8-98a5-1ccd9f4f6031" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:43:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:43:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:43:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:43:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:43:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:43:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:43:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:43:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:43:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:43:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.267s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:43:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:43:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:43:47 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:43:47 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:43:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8151MB free_disk=25.115028381347656GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:43:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:43:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:43:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:43:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:43:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:43:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 7d054231-82b5-43b0-967a-78f5ef690090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:43:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:43:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 488821ee-b1f3-4ae2-af06-739901164a6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:43:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1013f68f-ef99-4544-a3ce-d5f731b41606 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:43:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:43:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:43:48 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:43:48 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:43:48 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:43:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:43:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:43:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:43:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:43:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:43:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:43:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:43:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:04 user nova-compute[75018]: DEBUG nova.compute.manager [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:44:05 user nova-compute[75018]: INFO nova.compute.manager [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] instance snapshotting
Nov 07 15:44:05 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Beginning live snapshot process
Nov 07 15:44:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json -f qcow2 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json -f qcow2 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9zx3qzeh/02c5bc57201847d28dde5488d091ff1c.delta 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9zx3qzeh/02c5bc57201847d28dde5488d091ff1c.delta 1073741824" returned: 0 in 0.053s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:05 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 07 15:44:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75018) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 15:44:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75018) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 15:44:07 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 07 15:44:07 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:44:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9zx3qzeh/02c5bc57201847d28dde5488d091ff1c.delta /opt/stack/data/nova/instances/snapshots/tmp9zx3qzeh/02c5bc57201847d28dde5488d091ff1c {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9zx3qzeh/02c5bc57201847d28dde5488d091ff1c.delta /opt/stack/data/nova/instances/snapshots/tmp9zx3qzeh/02c5bc57201847d28dde5488d091ff1c" returned: 0 in 0.806s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:08 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Snapshot extracted, beginning image upload
Nov 07 15:44:10 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Snapshot image upload complete
Nov 07 15:44:10 user nova-compute[75018]: INFO nova.compute.manager [None req-24f2b077-87fc-4526-a59e-2badb1b29bd4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Took 5.75 seconds to snapshot the instance on the hypervisor.
Nov 07 15:44:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:44:11 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Creating image(s)
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Did not create local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Ensure instance console log exists: /opt/stack/data/nova/instances/488821ee-b1f3-4ae2-af06-739901164a6f/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Start _get_guest_xml network_info=[{"id": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "address": "fa:16:3e:5b:9c:07", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2849e4-13", "ovs_interfaceid": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDJVpavq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '488821ee-b1f3-4ae2-af06-739901164a6f', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8788460-9f20-4a53-b870-42b87b947f24', 'serial': 'd8788460-9f20-4a53-b870-42b87b947f24'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '45d38042-95f4-4b45-80a4-aac9d87e5e66', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:44:11 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:44:11 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDJVpavq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:44:11 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:44:11 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:44:11 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1863f0-4be9-4ad9-a401-37955279a705]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:44:11 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[174555cb-82ee-4c90-b71e-2407ed97b220]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24] added
Nov 07 15:44:11 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3570279-317d-4a1e-b20a-c019d401d065]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71d104e-56cd-4922-a4fc-2d9c682c97d8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZDJVpavq {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZDJVpavq" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[990861a9-bc49-44c5-837c-8f58b8f26378]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZDJVpavq'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc6d0a2-626e-4967-aed1-1c986917bc16]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef7a1d6-b9fc-45eb-bf86-63cf61765660]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:44:11 user nova-compute[75018]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:44:11 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:44:11 user nova-compute[75018]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:44:11 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e85b02f-24c8-479f-a14c-36f78dd16bde]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24, portal: 172.16.0.220,3260]
Nov 07 15:44:11 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24, portal: 172.16.0.220,3260] successful.
Nov 07 15:44:11 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3349f55f-797b-4317-a088-143e6e809c7e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[381a98ac-a2ba-4106-87b4-b5e253b10900]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:44:11 user nova-compute[75018]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:44:11 user nova-compute[75018]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 (non-flash)
Nov 07 15:44:11 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:44:11 user nova-compute[75018]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:44:11 user nova-compute[75018]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 (non-flash)
Nov 07 15:44:11 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[318ce756-3480-4306-a914-56046d1bbed2]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:44:11 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDJVpavq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23831386136396266', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831386136396266', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1579723789',display_name='tempest-TestVolumeBootPattern-server-1579723789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1579723789',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOx0I1sXmT3lNlIai/BUHgFfNVaXGOBAGMofft0DNWSqNxYy2hcxiNp28ynq7YoCKdrTjh2gh/Um6LAKOxg2FXW3PmC9v1rI7/vavPxOTEs++uuEyCh9xvBDXbOrVbSjA==',key_name='tempest-TestVolumeBootPattern-157413347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772e759d9a1d4d18ae43f53c731f87f2',ramdisk_id='',reservation_id='r-81uw43br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1644595019',owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:43:07Z,user_data=None,user_id='3ae23950e1e84c9693f8098c270ecb55',uuid=488821ee-b1f3-4ae2-af06-739901164a6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "address": "fa:16:3e:5b:9c:07", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2849e4-13", "ovs_interfaceid": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converting VIF {"id": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "address": "fa:16:3e:5b:9c:07", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2849e4-13", "ovs_interfaceid": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:9c:07,bridge_name='br-int',has_traffic_filtering=True,id=cb2849e4-1360-44fe-aae7-c0fececd0cfa,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2849e4-13') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG nova.objects.instance [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lazy-loading 'pci_devices' on Instance uuid 488821ee-b1f3-4ae2-af06-739901164a6f {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:44:12 user nova-compute[75018]:   <uuid>488821ee-b1f3-4ae2-af06-739901164a6f</uuid>
Nov 07 15:44:12 user nova-compute[75018]:   <name>instance-00000025</name>
Nov 07 15:44:12 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:44:12 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:44:12 user nova-compute[75018]:   <metadata>
Nov 07 15:44:12 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:44:12 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:44:12 user nova-compute[75018]:       <nova:name>tempest-TestVolumeBootPattern-server-1579723789</nova:name>
Nov 07 15:44:12 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:44:11</nova:creationTime>
Nov 07 15:44:12 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:44:12 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:44:12 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:44:12 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:44:12 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:44:12 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:44:12 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:44:12 user nova-compute[75018]:       <nova:owner>
Nov 07 15:44:12 user nova-compute[75018]:         <nova:user uuid="3ae23950e1e84c9693f8098c270ecb55">tempest-TestVolumeBootPattern-1644595019-project-member</nova:user>
Nov 07 15:44:12 user nova-compute[75018]:         <nova:project uuid="772e759d9a1d4d18ae43f53c731f87f2">tempest-TestVolumeBootPattern-1644595019</nova:project>
Nov 07 15:44:12 user nova-compute[75018]:       </nova:owner>
Nov 07 15:44:12 user nova-compute[75018]:       <nova:ports>
Nov 07 15:44:12 user nova-compute[75018]:         <nova:port uuid="cb2849e4-1360-44fe-aae7-c0fececd0cfa">
Nov 07 15:44:12 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 07 15:44:12 user nova-compute[75018]:         </nova:port>
Nov 07 15:44:12 user nova-compute[75018]:       </nova:ports>
Nov 07 15:44:12 user nova-compute[75018]:     </nova:instance>
Nov 07 15:44:12 user nova-compute[75018]:   </metadata>
Nov 07 15:44:12 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:44:12 user nova-compute[75018]:     <system>
Nov 07 15:44:12 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:44:12 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:44:12 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:44:12 user nova-compute[75018]:       <entry name="serial">488821ee-b1f3-4ae2-af06-739901164a6f</entry>
Nov 07 15:44:12 user nova-compute[75018]:       <entry name="uuid">488821ee-b1f3-4ae2-af06-739901164a6f</entry>
Nov 07 15:44:12 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:44:12 user nova-compute[75018]:     </system>
Nov 07 15:44:12 user nova-compute[75018]:   </sysinfo>
Nov 07 15:44:12 user nova-compute[75018]:   <os>
Nov 07 15:44:12 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:44:12 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:44:12 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:44:12 user nova-compute[75018]:   </os>
Nov 07 15:44:12 user nova-compute[75018]:   <features>
Nov 07 15:44:12 user nova-compute[75018]:     <acpi/>
Nov 07 15:44:12 user nova-compute[75018]:     <apic/>
Nov 07 15:44:12 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:44:12 user nova-compute[75018]:   </features>
Nov 07 15:44:12 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:44:12 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:44:12 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:44:12 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:44:12 user nova-compute[75018]:   </clock>
Nov 07 15:44:12 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:44:12 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:44:12 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:44:12 user nova-compute[75018]:   </cpu>
Nov 07 15:44:12 user nova-compute[75018]:   <devices>
Nov 07 15:44:12 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:44:12 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:44:12 user nova-compute[75018]:       <source dev="/dev/sdc"/>
Nov 07 15:44:12 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:44:12 user nova-compute[75018]:       <serial>d8788460-9f20-4a53-b870-42b87b947f24</serial>
Nov 07 15:44:12 user nova-compute[75018]:     </disk>
Nov 07 15:44:12 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:44:12 user nova-compute[75018]:       <mac address="fa:16:3e:5b:9c:07"/>
Nov 07 15:44:12 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:44:12 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:44:12 user nova-compute[75018]:       <target dev="tapcb2849e4-13"/>
Nov 07 15:44:12 user nova-compute[75018]:     </interface>
Nov 07 15:44:12 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:44:12 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/488821ee-b1f3-4ae2-af06-739901164a6f/console.log" append="off"/>
Nov 07 15:44:12 user nova-compute[75018]:     </serial>
Nov 07 15:44:12 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:44:12 user nova-compute[75018]:     <video>
Nov 07 15:44:12 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:44:12 user nova-compute[75018]:     </video>
Nov 07 15:44:12 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:44:12 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:44:12 user nova-compute[75018]:     </rng>
Nov 07 15:44:12 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:44:12 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:44:12 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:44:12 user nova-compute[75018]:     </memballoon>
Nov 07 15:44:12 user nova-compute[75018]:   </devices>
Nov 07 15:44:12 user nova-compute[75018]: </domain>
Nov 07 15:44:12 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1579723789',display_name='tempest-TestVolumeBootPattern-server-1579723789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1579723789',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOx0I1sXmT3lNlIai/BUHgFfNVaXGOBAGMofft0DNWSqNxYy2hcxiNp28ynq7YoCKdrTjh2gh/Um6LAKOxg2FXW3PmC9v1rI7/vavPxOTEs++uuEyCh9xvBDXbOrVbSjA==',key_name='tempest-TestVolumeBootPattern-157413347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772e759d9a1d4d18ae43f53c731f87f2',ramdisk_id='',reservation_id='r-81uw43br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1644595019',owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:43:07Z,user_data=None,user_id='3ae23950e1e84c9693f8098c270ecb55',uuid=488821ee-b1f3-4ae2-af06-739901164a6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "address": "fa:16:3e:5b:9c:07", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2849e4-13", "ovs_interfaceid": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converting VIF {"id": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "address": "fa:16:3e:5b:9c:07", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2849e4-13", "ovs_interfaceid": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:9c:07,bridge_name='br-int',has_traffic_filtering=True,id=cb2849e4-1360-44fe-aae7-c0fececd0cfa,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2849e4-13') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG os_vif [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:9c:07,bridge_name='br-int',has_traffic_filtering=True,id=cb2849e4-1360-44fe-aae7-c0fececd0cfa,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2849e4-13') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79ff4c61-d6c6-5f28-aad9-6be7cc3289c0', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb2849e4-13, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb2849e4-13, col_values=(('qos', UUID('1bfb8dfc-3675-47e6-815d-e934ce38b759')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb2849e4-13, col_values=(('external_ids', {'iface-id': 'cb2849e4-1360-44fe-aae7-c0fececd0cfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:9c:07', 'vm-uuid': '488821ee-b1f3-4ae2-af06-739901164a6f'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:12 user nova-compute[75018]: INFO os_vif [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:9c:07,bridge_name='br-int',has_traffic_filtering=True,id=cb2849e4-1360-44fe-aae7-c0fececd0cfa,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2849e4-13')
Nov 07 15:44:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] No VIF found with MAC fa:16:3e:5b:9c:07, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:44:13 user nova-compute[75018]: INFO nova.compute.claims [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Claim successful on node user
Nov 07 15:44:13 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:44:13 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:44:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:44:13 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Creating image(s)
Nov 07 15:44:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "/opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "/opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "/opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "f752fd49fbc48e946341b48e6cbab5e889fb4351" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "f752fd49fbc48e946341b48e6cbab5e889fb4351" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:13 user nova-compute[75018]: DEBUG nova.policy [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57812f43f52442b78301056926451ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e104a96f426475395c2074a5f84f5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:44:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351.part --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:15 user nova-compute[75018]: DEBUG nova.compute.manager [req-4cb4e8ab-7c56-479b-b07d-4df4a0523480 req-8361de02-907d-4aee-9621-771ec1f44867 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Received event network-vif-plugged-cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:44:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4cb4e8ab-7c56-479b-b07d-4df4a0523480 req-8361de02-907d-4aee-9621-771ec1f44867 service nova] Acquiring lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4cb4e8ab-7c56-479b-b07d-4df4a0523480 req-8361de02-907d-4aee-9621-771ec1f44867 service nova] Lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4cb4e8ab-7c56-479b-b07d-4df4a0523480 req-8361de02-907d-4aee-9621-771ec1f44867 service nova] Lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:15 user nova-compute[75018]: DEBUG nova.compute.manager [req-4cb4e8ab-7c56-479b-b07d-4df4a0523480 req-8361de02-907d-4aee-9621-771ec1f44867 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] No waiting events found dispatching network-vif-plugged-cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:44:15 user nova-compute[75018]: WARNING nova.compute.manager [req-4cb4e8ab-7c56-479b-b07d-4df4a0523480 req-8361de02-907d-4aee-9621-771ec1f44867 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Received unexpected event network-vif-plugged-cb2849e4-1360-44fe-aae7-c0fececd0cfa for instance with vm_state building and task_state spawning.
Nov 07 15:44:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351.part --force-share --output=json" returned: 0 in 0.197s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:15 user nova-compute[75018]: DEBUG nova.virt.images [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] dfc07533-29ec-4cae-9113-9135704d44ad was qcow2, converting to raw {{(pid=75018) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 15:44:15 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:44:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351.part /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351.converted {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351.part /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351.converted" returned: 0 in 0.880s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351.converted --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Successfully created port: 45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "f752fd49fbc48e946341b48e6cbab5e889fb4351" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.469s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351 --force-share --output=json" returned: 0 in 0.192s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "f752fd49fbc48e946341b48e6cbab5e889fb4351" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "f752fd49fbc48e946341b48e6cbab5e889fb4351" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351 --force-share --output=json" returned: 0 in 0.201s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351,backing_fmt=raw /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-29eb2b58-cbcc-44a3-910a-4a79303a7ad5 req-77312703-2523-4074-800e-655df960b8d4 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Received event network-vif-plugged-cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-29eb2b58-cbcc-44a3-910a-4a79303a7ad5 req-77312703-2523-4074-800e-655df960b8d4 service nova] Acquiring lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-29eb2b58-cbcc-44a3-910a-4a79303a7ad5 req-77312703-2523-4074-800e-655df960b8d4 service nova] Lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-29eb2b58-cbcc-44a3-910a-4a79303a7ad5 req-77312703-2523-4074-800e-655df960b8d4 service nova] Lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-29eb2b58-cbcc-44a3-910a-4a79303a7ad5 req-77312703-2523-4074-800e-655df960b8d4 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] No waiting events found dispatching network-vif-plugged-cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:44:16 user nova-compute[75018]: WARNING nova.compute.manager [req-29eb2b58-cbcc-44a3-910a-4a79303a7ad5 req-77312703-2523-4074-800e-655df960b8d4 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Received unexpected event network-vif-plugged-cb2849e4-1360-44fe-aae7-c0fececd0cfa for instance with vm_state building and task_state spawning.
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351,backing_fmt=raw /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk 1073741824" returned: 0 in 0.077s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "f752fd49fbc48e946341b48e6cbab5e889fb4351" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351 --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Ensure instance console log exists: /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Successfully updated port: 45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "refresh_cache-e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquired lock "refresh_cache-e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.compute.manager [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:44:17 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Instance spawned successfully.
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:44:17 user nova-compute[75018]: INFO nova.compute.manager [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.compute.manager [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:44:17 user nova-compute[75018]: INFO nova.compute.manager [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Took 71.17 seconds to build instance.
Nov 07 15:44:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-845bf1c5-24ca-4654-9e7b-5bd8b4109f22 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "488821ee-b1f3-4ae2-af06-739901164a6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 71.278s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Updating instance_info_cache with network_info: [{"id": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "address": "fa:16:3e:19:37:39", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d3ffca-a4", "ovs_interfaceid": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Releasing lock "refresh_cache-e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Instance network_info: |[{"id": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "address": "fa:16:3e:19:37:39", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d3ffca-a4", "ovs_interfaceid": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Start _get_guest_xml network_info=[{"id": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "address": "fa:16:3e:19:37:39", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d3ffca-a4", "ovs_interfaceid": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f6f2fc22ca10d290c0d088cb8c485e22',container_format='bare',created_at=2023-11-07T15:44:05Z,direct_url=<?>,disk_format='qcow2',id=dfc07533-29ec-4cae-9113-9135704d44ad,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1947490646',owner='2e104a96f426475395c2074a5f84f5c5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-07T15:44:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'dfc07533-29ec-4cae-9113-9135704d44ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:44:17 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:44:17 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f6f2fc22ca10d290c0d088cb8c485e22',container_format='bare',created_at=2023-11-07T15:44:05Z,direct_url=<?>,disk_format='qcow2',id=dfc07533-29ec-4cae-9113-9135704d44ad,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1947490646',owner='2e104a96f426475395c2074a5f84f5c5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-07T15:44:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-93077224',display_name='tempest-TestStampPattern-server-93077224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-93077224',id=39,image_ref='dfc07533-29ec-4cae-9113-9135704d44ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeDr8zIgWa3swsi8kRrbrY4v25ZocRcuaJSVAmNSRGFExsScPphVquqvdpzTXj7/U6FNeAF4YkECYqQe9DkYQFF9FKM0cchxIK1gDnEqMzhDHzyT8Y/sy8bS+7J/epnrg==',key_name='tempest-TestStampPattern-615359145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e104a96f426475395c2074a5f84f5c5',ramdisk_id='',reservation_id='r-xdgzctl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7d054231-82b5-43b0-967a-78f5ef690090',image_min_disk='1',image_min_ram='0',image_owner_id='2e104a96f426475395c2074a5f84f5c5',image_owner_project_name='tempest-TestStampPattern-885621001',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-885621001-project-member',image_user_id='57812f43f52442b78301056926451ad2',network_allocated='True',owner_project_name='tempest-TestStampPattern-885621001',owner_user_name='tempest-TestStampPattern-885621001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:44:14Z,user_data=None,user_id='57812f43f52442b78301056926451ad2',uuid=e542c40d-b3fc-4a79-9777-1d3beaf4a7c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "address": "fa:16:3e:19:37:39", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d3ffca-a4", "ovs_interfaceid": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Converting VIF {"id": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "address": "fa:16:3e:19:37:39", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d3ffca-a4", "ovs_interfaceid": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:37:39,bridge_name='br-int',has_traffic_filtering=True,id=45d3ffca-a4ed-4973-8ce0-9a077f3f59fa,network=Network(6df5c46f-af5e-4d93-a9fa-5224b27e5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45d3ffca-a4') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.objects.instance [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lazy-loading 'pci_devices' on Instance uuid e542c40d-b3fc-4a79-9777-1d3beaf4a7c3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:44:17 user nova-compute[75018]:   <uuid>e542c40d-b3fc-4a79-9777-1d3beaf4a7c3</uuid>
Nov 07 15:44:17 user nova-compute[75018]:   <name>instance-00000027</name>
Nov 07 15:44:17 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:44:17 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:44:17 user nova-compute[75018]:   <metadata>
Nov 07 15:44:17 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:44:17 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:44:17 user nova-compute[75018]:       <nova:name>tempest-TestStampPattern-server-93077224</nova:name>
Nov 07 15:44:17 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:44:17</nova:creationTime>
Nov 07 15:44:17 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:44:17 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:44:17 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:44:17 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:44:17 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:44:17 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:44:17 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:44:17 user nova-compute[75018]:       <nova:owner>
Nov 07 15:44:17 user nova-compute[75018]:         <nova:user uuid="57812f43f52442b78301056926451ad2">tempest-TestStampPattern-885621001-project-member</nova:user>
Nov 07 15:44:17 user nova-compute[75018]:         <nova:project uuid="2e104a96f426475395c2074a5f84f5c5">tempest-TestStampPattern-885621001</nova:project>
Nov 07 15:44:17 user nova-compute[75018]:       </nova:owner>
Nov 07 15:44:17 user nova-compute[75018]:       <nova:root type="image" uuid="dfc07533-29ec-4cae-9113-9135704d44ad"/>
Nov 07 15:44:17 user nova-compute[75018]:       <nova:ports>
Nov 07 15:44:17 user nova-compute[75018]:         <nova:port uuid="45d3ffca-a4ed-4973-8ce0-9a077f3f59fa">
Nov 07 15:44:17 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 15:44:17 user nova-compute[75018]:         </nova:port>
Nov 07 15:44:17 user nova-compute[75018]:       </nova:ports>
Nov 07 15:44:17 user nova-compute[75018]:     </nova:instance>
Nov 07 15:44:17 user nova-compute[75018]:   </metadata>
Nov 07 15:44:17 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:44:17 user nova-compute[75018]:     <system>
Nov 07 15:44:17 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:44:17 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:44:17 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:44:17 user nova-compute[75018]:       <entry name="serial">e542c40d-b3fc-4a79-9777-1d3beaf4a7c3</entry>
Nov 07 15:44:17 user nova-compute[75018]:       <entry name="uuid">e542c40d-b3fc-4a79-9777-1d3beaf4a7c3</entry>
Nov 07 15:44:17 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:44:17 user nova-compute[75018]:     </system>
Nov 07 15:44:17 user nova-compute[75018]:   </sysinfo>
Nov 07 15:44:17 user nova-compute[75018]:   <os>
Nov 07 15:44:17 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:44:17 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:44:17 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:44:17 user nova-compute[75018]:   </os>
Nov 07 15:44:17 user nova-compute[75018]:   <features>
Nov 07 15:44:17 user nova-compute[75018]:     <acpi/>
Nov 07 15:44:17 user nova-compute[75018]:     <apic/>
Nov 07 15:44:17 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:44:17 user nova-compute[75018]:   </features>
Nov 07 15:44:17 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:44:17 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:44:17 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:44:17 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:44:17 user nova-compute[75018]:   </clock>
Nov 07 15:44:17 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:44:17 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:44:17 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:44:17 user nova-compute[75018]:   </cpu>
Nov 07 15:44:17 user nova-compute[75018]:   <devices>
Nov 07 15:44:17 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:44:17 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:44:17 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk"/>
Nov 07 15:44:17 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:44:17 user nova-compute[75018]:     </disk>
Nov 07 15:44:17 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:44:17 user nova-compute[75018]:       <mac address="fa:16:3e:19:37:39"/>
Nov 07 15:44:17 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:44:17 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:44:17 user nova-compute[75018]:       <target dev="tap45d3ffca-a4"/>
Nov 07 15:44:17 user nova-compute[75018]:     </interface>
Nov 07 15:44:17 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:44:17 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/console.log" append="off"/>
Nov 07 15:44:17 user nova-compute[75018]:     </serial>
Nov 07 15:44:17 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:44:17 user nova-compute[75018]:     <video>
Nov 07 15:44:17 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:44:17 user nova-compute[75018]:     </video>
Nov 07 15:44:17 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:44:17 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:44:17 user nova-compute[75018]:     </rng>
Nov 07 15:44:17 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:44:17 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:44:17 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:44:17 user nova-compute[75018]:     </memballoon>
Nov 07 15:44:17 user nova-compute[75018]:   </devices>
Nov 07 15:44:17 user nova-compute[75018]: </domain>
Nov 07 15:44:17 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-93077224',display_name='tempest-TestStampPattern-server-93077224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-93077224',id=39,image_ref='dfc07533-29ec-4cae-9113-9135704d44ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeDr8zIgWa3swsi8kRrbrY4v25ZocRcuaJSVAmNSRGFExsScPphVquqvdpzTXj7/U6FNeAF4YkECYqQe9DkYQFF9FKM0cchxIK1gDnEqMzhDHzyT8Y/sy8bS+7J/epnrg==',key_name='tempest-TestStampPattern-615359145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e104a96f426475395c2074a5f84f5c5',ramdisk_id='',reservation_id='r-xdgzctl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7d054231-82b5-43b0-967a-78f5ef690090',image_min_disk='1',image_min_ram='0',image_owner_id='2e104a96f426475395c2074a5f84f5c5',image_owner_project_name='tempest-TestStampPattern-885621001',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-885621001-project-member',image_user_id='57812f43f52442b78301056926451ad2',network_allocated='True',owner_project_name='tempest-TestStampPattern-885621001',owner_user_name='tempest-TestStampPattern-885621001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:44:14Z,user_data=None,user_id='57812f43f52442b78301056926451ad2',uuid=e542c40d-b3fc-4a79-9777-1d3beaf4a7c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "address": "fa:16:3e:19:37:39", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d3ffca-a4", "ovs_interfaceid": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Converting VIF {"id": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "address": "fa:16:3e:19:37:39", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d3ffca-a4", "ovs_interfaceid": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:37:39,bridge_name='br-int',has_traffic_filtering=True,id=45d3ffca-a4ed-4973-8ce0-9a077f3f59fa,network=Network(6df5c46f-af5e-4d93-a9fa-5224b27e5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45d3ffca-a4') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG os_vif [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:37:39,bridge_name='br-int',has_traffic_filtering=True,id=45d3ffca-a4ed-4973-8ce0-9a077f3f59fa,network=Network(6df5c46f-af5e-4d93-a9fa-5224b27e5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45d3ffca-a4') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b55ac1cf-74fc-5cdd-8214-70b1609a3a3d', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45d3ffca-a4, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45d3ffca-a4, col_values=(('qos', UUID('933c4f69-70c3-41e2-8db5-dbd1148910ad')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45d3ffca-a4, col_values=(('external_ids', {'iface-id': '45d3ffca-a4ed-4973-8ce0-9a077f3f59fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:37:39', 'vm-uuid': 'e542c40d-b3fc-4a79-9777-1d3beaf4a7c3'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:17 user nova-compute[75018]: INFO os_vif [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:37:39,bridge_name='br-int',has_traffic_filtering=True,id=45d3ffca-a4ed-4973-8ce0-9a077f3f59fa,network=Network(6df5c46f-af5e-4d93-a9fa-5224b27e5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45d3ffca-a4')
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:44:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] No VIF found with MAC fa:16:3e:19:37:39, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:44:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-83a049dd-22d4-4ed6-9442-b480344f9c3d req-2b5de533-cb80-4ba5-afb8-1cb16735988a service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Received event network-changed-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:44:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-83a049dd-22d4-4ed6-9442-b480344f9c3d req-2b5de533-cb80-4ba5-afb8-1cb16735988a service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Refreshing instance network info cache due to event network-changed-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:44:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-83a049dd-22d4-4ed6-9442-b480344f9c3d req-2b5de533-cb80-4ba5-afb8-1cb16735988a service nova] Acquiring lock "refresh_cache-e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:44:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-83a049dd-22d4-4ed6-9442-b480344f9c3d req-2b5de533-cb80-4ba5-afb8-1cb16735988a service nova] Acquired lock "refresh_cache-e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:44:18 user nova-compute[75018]: DEBUG nova.network.neutron [req-83a049dd-22d4-4ed6-9442-b480344f9c3d req-2b5de533-cb80-4ba5-afb8-1cb16735988a service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Refreshing network info cache for port 45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:44:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:19 user nova-compute[75018]: DEBUG nova.network.neutron [req-83a049dd-22d4-4ed6-9442-b480344f9c3d req-2b5de533-cb80-4ba5-afb8-1cb16735988a service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Updated VIF entry in instance network info cache for port 45d3ffca-a4ed-4973-8ce0-9a077f3f59fa. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:44:19 user nova-compute[75018]: DEBUG nova.network.neutron [req-83a049dd-22d4-4ed6-9442-b480344f9c3d req-2b5de533-cb80-4ba5-afb8-1cb16735988a service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Updating instance_info_cache with network_info: [{"id": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "address": "fa:16:3e:19:37:39", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d3ffca-a4", "ovs_interfaceid": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:44:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-83a049dd-22d4-4ed6-9442-b480344f9c3d req-2b5de533-cb80-4ba5-afb8-1cb16735988a service nova] Releasing lock "refresh_cache-e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:44:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:19 user nova-compute[75018]: DEBUG nova.compute.manager [req-5da2df42-c532-4241-8244-885de349b323 req-263b4487-cbc4-4c51-8ada-12594a1aac3a service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Received event network-vif-plugged-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:44:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5da2df42-c532-4241-8244-885de349b323 req-263b4487-cbc4-4c51-8ada-12594a1aac3a service nova] Acquiring lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5da2df42-c532-4241-8244-885de349b323 req-263b4487-cbc4-4c51-8ada-12594a1aac3a service nova] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5da2df42-c532-4241-8244-885de349b323 req-263b4487-cbc4-4c51-8ada-12594a1aac3a service nova] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:19 user nova-compute[75018]: DEBUG nova.compute.manager [req-5da2df42-c532-4241-8244-885de349b323 req-263b4487-cbc4-4c51-8ada-12594a1aac3a service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] No waiting events found dispatching network-vif-plugged-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:44:19 user nova-compute[75018]: WARNING nova.compute.manager [req-5da2df42-c532-4241-8244-885de349b323 req-263b4487-cbc4-4c51-8ada-12594a1aac3a service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Received unexpected event network-vif-plugged-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa for instance with vm_state building and task_state spawning.
Nov 07 15:44:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:21 user nova-compute[75018]: DEBUG nova.compute.manager [req-26ff814a-171c-4451-abeb-f9779033598b req-cead4252-d187-426f-aa9d-55738db7066d service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Received event network-vif-plugged-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:44:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-26ff814a-171c-4451-abeb-f9779033598b req-cead4252-d187-426f-aa9d-55738db7066d service nova] Acquiring lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-26ff814a-171c-4451-abeb-f9779033598b req-cead4252-d187-426f-aa9d-55738db7066d service nova] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-26ff814a-171c-4451-abeb-f9779033598b req-cead4252-d187-426f-aa9d-55738db7066d service nova] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:21 user nova-compute[75018]: DEBUG nova.compute.manager [req-26ff814a-171c-4451-abeb-f9779033598b req-cead4252-d187-426f-aa9d-55738db7066d service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] No waiting events found dispatching network-vif-plugged-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:44:21 user nova-compute[75018]: WARNING nova.compute.manager [req-26ff814a-171c-4451-abeb-f9779033598b req-cead4252-d187-426f-aa9d-55738db7066d service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Received unexpected event network-vif-plugged-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa for instance with vm_state building and task_state spawning.
Nov 07 15:44:22 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:44:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:44:22 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Instance spawned successfully.
Nov 07 15:44:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:44:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:44:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:44:22 user nova-compute[75018]: INFO nova.compute.manager [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Took 8.44 seconds to spawn the instance on the hypervisor.
Nov 07 15:44:22 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:44:22 user nova-compute[75018]: INFO nova.compute.manager [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Took 9.26 seconds to build instance.
Nov 07 15:44:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fe811cb2-c5bf-4fc5-bafd-82b9ba2d8082 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.401s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:44:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:34 user nova-compute[75018]: INFO nova.compute.manager [None req-69aa8e83-a2d9-45c9-aa02-cbf7690ba578 tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Get console output
Nov 07 15:44:34 user nova-compute[75018]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 07 15:44:35 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:44:35 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:44:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:36 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:44:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:39 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:44:39 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:44:39 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:44:40 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:44:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:44:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:44:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:44:40 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:44:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Updating instance_info_cache with network_info: [{"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:44:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-626a4817-31f4-48c8-9ab6-07d539dd0a14" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:44:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:44:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:44:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:44:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:44:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:44 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:44:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:44:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:44 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:44:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:44:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:44:47 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:44:47 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:44:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7788MB free_disk=24.941509246826172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 7d054231-82b5-43b0-967a-78f5ef690090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 488821ee-b1f3-4ae2-af06-739901164a6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1013f68f-ef99-4544-a3ce-d5f731b41606 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e542c40d-b3fc-4a79-9777-1d3beaf4a7c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:44:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:53 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:44:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:56 user nova-compute[75018]: INFO nova.compute.manager [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Terminating instance
Nov 07 15:44:56 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-77411cfb-fa80-4976-a129-09ea63768747 req-3e761765-dd8d-4a87-915a-5ff69d95363d service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received event network-vif-unplugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-77411cfb-fa80-4976-a129-09ea63768747 req-3e761765-dd8d-4a87-915a-5ff69d95363d service nova] Acquiring lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-77411cfb-fa80-4976-a129-09ea63768747 req-3e761765-dd8d-4a87-915a-5ff69d95363d service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-77411cfb-fa80-4976-a129-09ea63768747 req-3e761765-dd8d-4a87-915a-5ff69d95363d service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-77411cfb-fa80-4976-a129-09ea63768747 req-3e761765-dd8d-4a87-915a-5ff69d95363d service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] No waiting events found dispatching network-vif-unplugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-77411cfb-fa80-4976-a129-09ea63768747 req-3e761765-dd8d-4a87-915a-5ff69d95363d service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received event network-vif-unplugged-2ac8ec41-3720-4115-95a3-eef616ddb29e for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:57 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Instance destroyed successfully.
Nov 07 15:44:57 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'resources' on Instance uuid 1e6465d9-6a61-4d6b-b876-ffdd9878fc28 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-75372014',display_name='tempest-ServerRescueNegativeTestJSON-server-75372014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-75372014',id=18,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374a202b7d114f009ac374762e08c364',ramdisk_id='',reservation_id='r-1uwnu000',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1476352427',owner_user_name='tempest-ServerRescueNegativeTestJSON-1476352427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:29:49Z,user_data=None,user_id='869a94fcb52246d583be8bac4a722a3c',uuid=1e6465d9-6a61-4d6b-b876-ffdd9878fc28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converting VIF {"id": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "address": "fa:16:3e:d6:97:7a", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac8ec41-37", "ovs_interfaceid": "2ac8ec41-3720-4115-95a3-eef616ddb29e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:97:7a,bridge_name='br-int',has_traffic_filtering=True,id=2ac8ec41-3720-4115-95a3-eef616ddb29e,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac8ec41-37') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG os_vif [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:97:7a,bridge_name='br-int',has_traffic_filtering=True,id=2ac8ec41-3720-4115-95a3-eef616ddb29e,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac8ec41-37') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ac8ec41-37, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f21e6ac3-3c78-42c6-bdf9-15971c4b0811) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:44:57 user nova-compute[75018]: INFO os_vif [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:97:7a,bridge_name='br-int',has_traffic_filtering=True,id=2ac8ec41-3720-4115-95a3-eef616ddb29e,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac8ec41-37')
Nov 07 15:44:57 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Deleting instance files /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28_del
Nov 07 15:44:57 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Deletion of /opt/stack/data/nova/instances/1e6465d9-6a61-4d6b-b876-ffdd9878fc28_del complete
Nov 07 15:44:57 user nova-compute[75018]: INFO nova.compute.manager [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 07 15:44:57 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:44:57 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:44:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:44:58 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:44:58 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Took 0.90 seconds to deallocate network for instance.
Nov 07 15:44:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:59 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:44:59 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:44:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:59 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Deleted allocations for instance 1e6465d9-6a61-4d6b-b876-ffdd9878fc28
Nov 07 15:44:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c5470239-6e33-404c-b962-df874091a8c0 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.337s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-86921189-d30f-4154-a754-6a7555fd4966 req-b9d6ec24-3884-471f-98e1-1d503bc292ff service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received event network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:44:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-86921189-d30f-4154-a754-6a7555fd4966 req-b9d6ec24-3884-471f-98e1-1d503bc292ff service nova] Acquiring lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:44:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-86921189-d30f-4154-a754-6a7555fd4966 req-b9d6ec24-3884-471f-98e1-1d503bc292ff service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:44:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-86921189-d30f-4154-a754-6a7555fd4966 req-b9d6ec24-3884-471f-98e1-1d503bc292ff service nova] Lock "1e6465d9-6a61-4d6b-b876-ffdd9878fc28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:44:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-86921189-d30f-4154-a754-6a7555fd4966 req-b9d6ec24-3884-471f-98e1-1d503bc292ff service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] No waiting events found dispatching network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:44:59 user nova-compute[75018]: WARNING nova.compute.manager [req-86921189-d30f-4154-a754-6a7555fd4966 req-b9d6ec24-3884-471f-98e1-1d503bc292ff service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received unexpected event network-vif-plugged-2ac8ec41-3720-4115-95a3-eef616ddb29e for instance with vm_state deleted and task_state None.
Nov 07 15:44:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-86921189-d30f-4154-a754-6a7555fd4966 req-b9d6ec24-3884-471f-98e1-1d503bc292ff service nova] [instance: 1e6465d9-6a61-4d6b-b876-ffdd9878fc28] Received event network-vif-deleted-2ac8ec41-3720-4115-95a3-eef616ddb29e {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:04 user nova-compute[75018]: DEBUG nova.compute.manager [req-c97ca42b-7f98-462d-9832-9b0d84a7a0dc req-3795cbcc-f872-4095-bf06-a7e93474fa47 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-changed-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:04 user nova-compute[75018]: DEBUG nova.compute.manager [req-c97ca42b-7f98-462d-9832-9b0d84a7a0dc req-3795cbcc-f872-4095-bf06-a7e93474fa47 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Refreshing instance network info cache due to event network-changed-74fe6639-8825-4ac6-ad52-3c5a6773857f. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:45:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c97ca42b-7f98-462d-9832-9b0d84a7a0dc req-3795cbcc-f872-4095-bf06-a7e93474fa47 service nova] Acquiring lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:45:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c97ca42b-7f98-462d-9832-9b0d84a7a0dc req-3795cbcc-f872-4095-bf06-a7e93474fa47 service nova] Acquired lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:45:04 user nova-compute[75018]: DEBUG nova.network.neutron [req-c97ca42b-7f98-462d-9832-9b0d84a7a0dc req-3795cbcc-f872-4095-bf06-a7e93474fa47 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Refreshing network info cache for port 74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:45:04 user nova-compute[75018]: DEBUG nova.network.neutron [req-c97ca42b-7f98-462d-9832-9b0d84a7a0dc req-3795cbcc-f872-4095-bf06-a7e93474fa47 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updated VIF entry in instance network info cache for port 74fe6639-8825-4ac6-ad52-3c5a6773857f. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:45:04 user nova-compute[75018]: DEBUG nova.network.neutron [req-c97ca42b-7f98-462d-9832-9b0d84a7a0dc req-3795cbcc-f872-4095-bf06-a7e93474fa47 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updating instance_info_cache with network_info: [{"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:45:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c97ca42b-7f98-462d-9832-9b0d84a7a0dc req-3795cbcc-f872-4095-bf06-a7e93474fa47 service nova] Releasing lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:45:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "1013f68f-ef99-4544-a3ce-d5f731b41606" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:04 user nova-compute[75018]: INFO nova.compute.manager [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Shelve offloading
Nov 07 15:45:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:05 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Instance destroyed successfully.
Nov 07 15:45:05 user nova-compute[75018]: DEBUG nova.compute.manager [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:45:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:45:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquired lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:45:05 user nova-compute[75018]: DEBUG nova.network.neutron [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:45:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:05 user nova-compute[75018]: DEBUG nova.compute.manager [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:45:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:05 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:45:05 user nova-compute[75018]: INFO nova.compute.claims [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Claim successful on node user
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.network.neutron [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updating instance_info_cache with network_info: [{"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Releasing lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.compute.manager [req-0f1ec1dc-a2f6-4a0f-844a-91830c27f44f req-b2a77a4e-d7fb-4964-975d-d3222427a211 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-vif-unplugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0f1ec1dc-a2f6-4a0f-844a-91830c27f44f req-b2a77a4e-d7fb-4964-975d-d3222427a211 service nova] Acquiring lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0f1ec1dc-a2f6-4a0f-844a-91830c27f44f req-b2a77a4e-d7fb-4964-975d-d3222427a211 service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0f1ec1dc-a2f6-4a0f-844a-91830c27f44f req-b2a77a4e-d7fb-4964-975d-d3222427a211 service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.compute.manager [req-0f1ec1dc-a2f6-4a0f-844a-91830c27f44f req-b2a77a4e-d7fb-4964-975d-d3222427a211 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] No waiting events found dispatching network-vif-unplugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:45:06 user nova-compute[75018]: WARNING nova.compute.manager [req-0f1ec1dc-a2f6-4a0f-844a-91830c27f44f req-b2a77a4e-d7fb-4964-975d-d3222427a211 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received unexpected event network-vif-unplugged-74fe6639-8825-4ac6-ad52-3c5a6773857f for instance with vm_state active and task_state shelving.
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.network.neutron [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:45:06 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.policy [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '539a5c7025bc4f8a8d68892e015cbab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c836eb1cc36a4724995e31466a2a8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:45:06 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Instance destroyed successfully.
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.objects.instance [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lazy-loading 'resources' on Instance uuid 1013f68f-ef99-4544-a3ce-d5f731b41606 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-465451204',display_name='tempest-TestShelveInstance-server-465451204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-465451204',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuVrEFrwEj6OeOOAGIW8mZfqkBlLHl15boYTLN4+rcHDOhOesO3XWH7Ay0ZCO8ZExQ4Qyy6ptmZx4rXdAah8ySoRuw/DOtcmuwWoHoxlfWmN131iGvvcoSdfQFQfrQe3A==',key_name='tempest-TestShelveInstance-486488334',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:43:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0f296caee0c4c87acaf64774de69cfb',ramdisk_id='',reservation_id='r-p7bfb4yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1838376973',owner_user_name='tempest-TestShelveInstance-1838376973-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:43:41Z,user_data=None,user_id='078ecf188a31491c9841224829899661',uuid=1013f68f-ef99-4544-a3ce-d5f731b41606,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Converting VIF {"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=74fe6639-8825-4ac6-ad52-3c5a6773857f,network=Network(1ec84201-4506-4c97-8ea5-9536271fb4f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fe6639-88') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG os_vif [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=74fe6639-8825-4ac6-ad52-3c5a6773857f,network=Network(1ec84201-4506-4c97-8ea5-9536271fb4f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fe6639-88') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74fe6639-88, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:45:06 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Creating image(s)
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "/opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "/opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "/opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.compute.manager [req-5ee12e2b-a87e-46a2-a196-95b9f1cdedc5 req-e235ac4c-89c8-45b1-ac51-cd5f1b1265f1 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-changed-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.compute.manager [req-5ee12e2b-a87e-46a2-a196-95b9f1cdedc5 req-e235ac4c-89c8-45b1-ac51-cd5f1b1265f1 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Refreshing instance network info cache due to event network-changed-74fe6639-8825-4ac6-ad52-3c5a6773857f. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5ee12e2b-a87e-46a2-a196-95b9f1cdedc5 req-e235ac4c-89c8-45b1-ac51-cd5f1b1265f1 service nova] Acquiring lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5ee12e2b-a87e-46a2-a196-95b9f1cdedc5 req-e235ac4c-89c8-45b1-ac51-cd5f1b1265f1 service nova] Acquired lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.network.neutron [req-5ee12e2b-a87e-46a2-a196-95b9f1cdedc5 req-e235ac4c-89c8-45b1-ac51-cd5f1b1265f1 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Refreshing network info cache for port 74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef965756-bdd5-41f3-87a8-0af1da0e9905) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:45:06 user nova-compute[75018]: INFO os_vif [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=74fe6639-8825-4ac6-ad52-3c5a6773857f,network=Network(1ec84201-4506-4c97-8ea5-9536271fb4f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fe6639-88')
Nov 07 15:45:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgnlWfCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:45:06 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:45:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cbb085-285d-457c-8def-8fc718a87745]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:45:06 user nova-compute[75018]: No targets found.
Nov 07 15:45:06 user nova-compute[75018]: iSNS:
Nov 07 15:45:06 user nova-compute[75018]: No targets found.
Nov 07 15:45:06 user nova-compute[75018]: STATIC:
Nov 07 15:45:06 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee
Nov 07 15:45:06 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:45:06 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:45:06 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89
Nov 07 15:45:06 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:45:06 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:45:06 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24
Nov 07 15:45:06 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:45:06 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:45:06 user nova-compute[75018]: FIRMWARE:
Nov 07 15:45:06 user nova-compute[75018]: No targets found.
Nov 07 15:45:06 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:45:06 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:45:06 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cae4e2-4577-4f9a-8880-707ece0fec80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abc5bbd-6262-4f21-abb6-356dc6307501]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:45:06 user nova-compute[75018]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:45:06 user nova-compute[75018]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 (non-flash)
Nov 07 15:45:06 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:45:06 user nova-compute[75018]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:45:06 user nova-compute[75018]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 (non-flash)
Nov 07 15:45:06 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae0332320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.197s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf949a0-bfa8-4d27-9888-3eb7296ea2f9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3663b5-4d0c-484b-b9be-9687d46e1433]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ad25d7-183c-445f-8810-026dcb8d7ec8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:45:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aa7d66-6074-4ac1-a7da-1ba9e249ed9c]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[af50145e-7a6c-46b3-97f1-bc4c26cc5048]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.191s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e4804d-50df-412a-ac0a-c2c1777a5039]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260]
Nov 07 15:45:07 user nova-compute[75018]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260] successful.
Nov 07 15:45:07 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk 1073741824" returned: 0 in 0.059s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e211b1e-25cf-46f9-8053-70d27b50057e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] <== disconnect_volume: return (399ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:45:07 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Deleting instance files /opt/stack/data/nova/instances/1013f68f-ef99-4544-a3ce-d5f731b41606_del
Nov 07 15:45:07 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Deletion of /opt/stack/data/nova/instances/1013f68f-ef99-4544-a3ce-d5f731b41606_del complete
Nov 07 15:45:07 user nova-compute[75018]: DEBUG nova.network.neutron [req-5ee12e2b-a87e-46a2-a196-95b9f1cdedc5 req-e235ac4c-89c8-45b1-ac51-cd5f1b1265f1 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updated VIF entry in instance network info cache for port 74fe6639-8825-4ac6-ad52-3c5a6773857f. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG nova.network.neutron [req-5ee12e2b-a87e-46a2-a196-95b9f1cdedc5 req-e235ac4c-89c8-45b1-ac51-cd5f1b1265f1 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updating instance_info_cache with network_info: [{"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": null, "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap74fe6639-88", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5ee12e2b-a87e-46a2-a196-95b9f1cdedc5 req-e235ac4c-89c8-45b1-ac51-cd5f1b1265f1 service nova] Releasing lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.191s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG nova.network.neutron [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Successfully created port: 46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Cannot resize image /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Ensure instance console log exists: /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.network.neutron [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Successfully updated port: 46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquired lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.network.neutron [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-e96c3fe3-bcbc-429a-9a36-afdc52775dcb req-d22bdf5d-5285-4c61-8104-b6a07117137b service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e96c3fe3-bcbc-429a-9a36-afdc52775dcb req-d22bdf5d-5285-4c61-8104-b6a07117137b service nova] Acquiring lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e96c3fe3-bcbc-429a-9a36-afdc52775dcb req-d22bdf5d-5285-4c61-8104-b6a07117137b service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e96c3fe3-bcbc-429a-9a36-afdc52775dcb req-d22bdf5d-5285-4c61-8104-b6a07117137b service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-e96c3fe3-bcbc-429a-9a36-afdc52775dcb req-d22bdf5d-5285-4c61-8104-b6a07117137b service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] No waiting events found dispatching network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:45:08 user nova-compute[75018]: WARNING nova.compute.manager [req-e96c3fe3-bcbc-429a-9a36-afdc52775dcb req-d22bdf5d-5285-4c61-8104-b6a07117137b service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received unexpected event network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f for instance with vm_state active and task_state shelving.
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-e96c3fe3-bcbc-429a-9a36-afdc52775dcb req-d22bdf5d-5285-4c61-8104-b6a07117137b service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Received event network-changed-46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-e96c3fe3-bcbc-429a-9a36-afdc52775dcb req-d22bdf5d-5285-4c61-8104-b6a07117137b service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Refreshing instance network info cache due to event network-changed-46f42a26-dde5-43b8-a247-c6e8b56a96de. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e96c3fe3-bcbc-429a-9a36-afdc52775dcb req-d22bdf5d-5285-4c61-8104-b6a07117137b service nova] Acquiring lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.network.neutron [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:45:08 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Deleted allocations for instance 1013f68f-ef99-4544-a3ce-d5f731b41606
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.network.neutron [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updating instance_info_cache with network_info: [{"id": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "address": "fa:16:3e:9a:04:46", "network": {"id": "a71702a4-b590-4647-8237-28eb0fcd9230", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1031019268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c836eb1cc36a4724995e31466a2a8c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f42a26-dd", "ovs_interfaceid": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Releasing lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.compute.manager [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Instance network_info: |[{"id": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "address": "fa:16:3e:9a:04:46", "network": {"id": "a71702a4-b590-4647-8237-28eb0fcd9230", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1031019268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c836eb1cc36a4724995e31466a2a8c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f42a26-dd", "ovs_interfaceid": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e96c3fe3-bcbc-429a-9a36-afdc52775dcb req-d22bdf5d-5285-4c61-8104-b6a07117137b service nova] Acquired lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.network.neutron [req-e96c3fe3-bcbc-429a-9a36-afdc52775dcb req-d22bdf5d-5285-4c61-8104-b6a07117137b service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Refreshing network info cache for port 46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Start _get_guest_xml network_info=[{"id": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "address": "fa:16:3e:9a:04:46", "network": {"id": "a71702a4-b590-4647-8237-28eb0fcd9230", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1031019268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c836eb1cc36a4724995e31466a2a8c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f42a26-dd", "ovs_interfaceid": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:45:08 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:45:08 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:45:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.objects.instance [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lazy-loading 'numa_topology' on Instance uuid 1013f68f-ef99-4544-a3ce-d5f731b41606 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1868741104',display_name='tempest-SnapshotDataIntegrityTests-server-1868741104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1868741104',id=40,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMoqJVJpTqe3QrlEI329rti+/tKDrp+Mf65h7IftV93ygtjf+nXuM72IPT27LRDnU/O9wEEGTDZFArZN6xgj1i4wj59TrD/sBMYL/7QuosZ859OT+96K7w5Wr5ZugG1+A==',key_name='tempest-keypair-441338183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c836eb1cc36a4724995e31466a2a8c56',ramdisk_id='',reservation_id='r-45i8d4w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1770219978',owner_user_name='tempest-SnapshotDataIntegrityTests-1770219978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:45:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539a5c7025bc4f8a8d68892e015cbab0',uuid=64559109-6166-488d-a457-20b5f01ddf40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "address": "fa:16:3e:9a:04:46", "network": {"id": "a71702a4-b590-4647-8237-28eb0fcd9230", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1031019268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c836eb1cc36a4724995e31466a2a8c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f42a26-dd", "ovs_interfaceid": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Converting VIF {"id": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "address": "fa:16:3e:9a:04:46", "network": {"id": "a71702a4-b590-4647-8237-28eb0fcd9230", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1031019268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c836eb1cc36a4724995e31466a2a8c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f42a26-dd", "ovs_interfaceid": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:46,bridge_name='br-int',has_traffic_filtering=True,id=46f42a26-dde5-43b8-a247-c6e8b56a96de,network=Network(a71702a4-b590-4647-8237-28eb0fcd9230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f42a26-dd') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.objects.instance [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lazy-loading 'pci_devices' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.objects.base [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Object Instance<1013f68f-ef99-4544-a3ce-d5f731b41606> lazy-loaded attributes: resources,numa_topology {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:45:08 user nova-compute[75018]:   <uuid>64559109-6166-488d-a457-20b5f01ddf40</uuid>
Nov 07 15:45:08 user nova-compute[75018]:   <name>instance-00000028</name>
Nov 07 15:45:08 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:45:08 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:45:08 user nova-compute[75018]:   <metadata>
Nov 07 15:45:08 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:45:08 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:45:08 user nova-compute[75018]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1868741104</nova:name>
Nov 07 15:45:08 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:45:08</nova:creationTime>
Nov 07 15:45:08 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:45:08 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:45:08 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:45:08 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:45:08 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:45:08 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:45:08 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:45:08 user nova-compute[75018]:       <nova:owner>
Nov 07 15:45:08 user nova-compute[75018]:         <nova:user uuid="539a5c7025bc4f8a8d68892e015cbab0">tempest-SnapshotDataIntegrityTests-1770219978-project-member</nova:user>
Nov 07 15:45:08 user nova-compute[75018]:         <nova:project uuid="c836eb1cc36a4724995e31466a2a8c56">tempest-SnapshotDataIntegrityTests-1770219978</nova:project>
Nov 07 15:45:08 user nova-compute[75018]:       </nova:owner>
Nov 07 15:45:08 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:45:08 user nova-compute[75018]:       <nova:ports>
Nov 07 15:45:08 user nova-compute[75018]:         <nova:port uuid="46f42a26-dde5-43b8-a247-c6e8b56a96de">
Nov 07 15:45:08 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 07 15:45:08 user nova-compute[75018]:         </nova:port>
Nov 07 15:45:08 user nova-compute[75018]:       </nova:ports>
Nov 07 15:45:08 user nova-compute[75018]:     </nova:instance>
Nov 07 15:45:08 user nova-compute[75018]:   </metadata>
Nov 07 15:45:08 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:45:08 user nova-compute[75018]:     <system>
Nov 07 15:45:08 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:45:08 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:45:08 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:45:08 user nova-compute[75018]:       <entry name="serial">64559109-6166-488d-a457-20b5f01ddf40</entry>
Nov 07 15:45:08 user nova-compute[75018]:       <entry name="uuid">64559109-6166-488d-a457-20b5f01ddf40</entry>
Nov 07 15:45:08 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:45:08 user nova-compute[75018]:     </system>
Nov 07 15:45:08 user nova-compute[75018]:   </sysinfo>
Nov 07 15:45:08 user nova-compute[75018]:   <os>
Nov 07 15:45:08 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:45:08 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:45:08 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:45:08 user nova-compute[75018]:   </os>
Nov 07 15:45:08 user nova-compute[75018]:   <features>
Nov 07 15:45:08 user nova-compute[75018]:     <acpi/>
Nov 07 15:45:08 user nova-compute[75018]:     <apic/>
Nov 07 15:45:08 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:45:08 user nova-compute[75018]:   </features>
Nov 07 15:45:08 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:45:08 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:45:08 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:45:08 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:45:08 user nova-compute[75018]:   </clock>
Nov 07 15:45:08 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:45:08 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:45:08 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:45:08 user nova-compute[75018]:   </cpu>
Nov 07 15:45:08 user nova-compute[75018]:   <devices>
Nov 07 15:45:08 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:45:08 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:45:08 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk"/>
Nov 07 15:45:08 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:45:08 user nova-compute[75018]:     </disk>
Nov 07 15:45:08 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:45:08 user nova-compute[75018]:       <mac address="fa:16:3e:9a:04:46"/>
Nov 07 15:45:08 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:45:08 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:45:08 user nova-compute[75018]:       <target dev="tap46f42a26-dd"/>
Nov 07 15:45:08 user nova-compute[75018]:     </interface>
Nov 07 15:45:08 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:45:08 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/console.log" append="off"/>
Nov 07 15:45:08 user nova-compute[75018]:     </serial>
Nov 07 15:45:08 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:45:08 user nova-compute[75018]:     <video>
Nov 07 15:45:08 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:45:08 user nova-compute[75018]:     </video>
Nov 07 15:45:08 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:45:08 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:45:08 user nova-compute[75018]:     </rng>
Nov 07 15:45:08 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:45:08 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:45:08 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:45:08 user nova-compute[75018]:     </memballoon>
Nov 07 15:45:08 user nova-compute[75018]:   </devices>
Nov 07 15:45:08 user nova-compute[75018]: </domain>
Nov 07 15:45:08 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1868741104',display_name='tempest-SnapshotDataIntegrityTests-server-1868741104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1868741104',id=40,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMoqJVJpTqe3QrlEI329rti+/tKDrp+Mf65h7IftV93ygtjf+nXuM72IPT27LRDnU/O9wEEGTDZFArZN6xgj1i4wj59TrD/sBMYL/7QuosZ859OT+96K7w5Wr5ZugG1+A==',key_name='tempest-keypair-441338183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c836eb1cc36a4724995e31466a2a8c56',ramdisk_id='',reservation_id='r-45i8d4w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1770219978',owner_user_name='tempest-SnapshotDataIntegrityTests-1770219978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:45:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539a5c7025bc4f8a8d68892e015cbab0',uuid=64559109-6166-488d-a457-20b5f01ddf40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "address": "fa:16:3e:9a:04:46", "network": {"id": "a71702a4-b590-4647-8237-28eb0fcd9230", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1031019268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c836eb1cc36a4724995e31466a2a8c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f42a26-dd", "ovs_interfaceid": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Converting VIF {"id": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "address": "fa:16:3e:9a:04:46", "network": {"id": "a71702a4-b590-4647-8237-28eb0fcd9230", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1031019268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c836eb1cc36a4724995e31466a2a8c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f42a26-dd", "ovs_interfaceid": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:46,bridge_name='br-int',has_traffic_filtering=True,id=46f42a26-dde5-43b8-a247-c6e8b56a96de,network=Network(a71702a4-b590-4647-8237-28eb0fcd9230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f42a26-dd') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG os_vif [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:46,bridge_name='br-int',has_traffic_filtering=True,id=46f42a26-dde5-43b8-a247-c6e8b56a96de,network=Network(a71702a4-b590-4647-8237-28eb0fcd9230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f42a26-dd') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9309d105-5c42-5f5a-8d74-6b813f07cd02', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46f42a26-dd, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46f42a26-dd, col_values=(('qos', UUID('2bb9e19e-8361-47c4-a63c-488ae02e2e6b')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46f42a26-dd, col_values=(('external_ids', {'iface-id': '46f42a26-dde5-43b8-a247-c6e8b56a96de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:04:46', 'vm-uuid': '64559109-6166-488d-a457-20b5f01ddf40'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:08 user nova-compute[75018]: INFO os_vif [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:46,bridge_name='br-int',has_traffic_filtering=True,id=46f42a26-dde5-43b8-a247-c6e8b56a96de,network=Network(a71702a4-b590-4647-8237-28eb0fcd9230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f42a26-dd')
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] No VIF found with MAC fa:16:3e:9a:04:46, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:45:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11d7da08-eb4b-4288-bbf2-674ca1958549 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.221s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:09 user nova-compute[75018]: DEBUG nova.network.neutron [req-e96c3fe3-bcbc-429a-9a36-afdc52775dcb req-d22bdf5d-5285-4c61-8104-b6a07117137b service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updated VIF entry in instance network info cache for port 46f42a26-dde5-43b8-a247-c6e8b56a96de. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:45:09 user nova-compute[75018]: DEBUG nova.network.neutron [req-e96c3fe3-bcbc-429a-9a36-afdc52775dcb req-d22bdf5d-5285-4c61-8104-b6a07117137b service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updating instance_info_cache with network_info: [{"id": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "address": "fa:16:3e:9a:04:46", "network": {"id": "a71702a4-b590-4647-8237-28eb0fcd9230", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1031019268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c836eb1cc36a4724995e31466a2a8c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f42a26-dd", "ovs_interfaceid": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:45:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e96c3fe3-bcbc-429a-9a36-afdc52775dcb req-d22bdf5d-5285-4c61-8104-b6a07117137b service nova] Releasing lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:45:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-8147e0ab-bf6e-489c-9154-21c5f49eecbd req-5b9eb23b-00c1-4e71-a326-44466f251cc8 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Received event network-vif-plugged-46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8147e0ab-bf6e-489c-9154-21c5f49eecbd req-5b9eb23b-00c1-4e71-a326-44466f251cc8 service nova] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8147e0ab-bf6e-489c-9154-21c5f49eecbd req-5b9eb23b-00c1-4e71-a326-44466f251cc8 service nova] Lock "64559109-6166-488d-a457-20b5f01ddf40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8147e0ab-bf6e-489c-9154-21c5f49eecbd req-5b9eb23b-00c1-4e71-a326-44466f251cc8 service nova] Lock "64559109-6166-488d-a457-20b5f01ddf40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-8147e0ab-bf6e-489c-9154-21c5f49eecbd req-5b9eb23b-00c1-4e71-a326-44466f251cc8 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] No waiting events found dispatching network-vif-plugged-46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:45:10 user nova-compute[75018]: WARNING nova.compute.manager [req-8147e0ab-bf6e-489c-9154-21c5f49eecbd req-5b9eb23b-00c1-4e71-a326-44466f251cc8 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Received unexpected event network-vif-plugged-46f42a26-dde5-43b8-a247-c6e8b56a96de for instance with vm_state building and task_state spawning.
Nov 07 15:45:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:12 user nova-compute[75018]: DEBUG nova.compute.manager [req-ddfdef51-c349-49c4-807a-7614dc69ddaf req-a8987a79-2303-422e-87ee-6958afc95b58 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Received event network-vif-plugged-46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ddfdef51-c349-49c4-807a-7614dc69ddaf req-a8987a79-2303-422e-87ee-6958afc95b58 service nova] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ddfdef51-c349-49c4-807a-7614dc69ddaf req-a8987a79-2303-422e-87ee-6958afc95b58 service nova] Lock "64559109-6166-488d-a457-20b5f01ddf40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ddfdef51-c349-49c4-807a-7614dc69ddaf req-a8987a79-2303-422e-87ee-6958afc95b58 service nova] Lock "64559109-6166-488d-a457-20b5f01ddf40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:12 user nova-compute[75018]: DEBUG nova.compute.manager [req-ddfdef51-c349-49c4-807a-7614dc69ddaf req-a8987a79-2303-422e-87ee-6958afc95b58 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] No waiting events found dispatching network-vif-plugged-46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:45:12 user nova-compute[75018]: WARNING nova.compute.manager [req-ddfdef51-c349-49c4-807a-7614dc69ddaf req-a8987a79-2303-422e-87ee-6958afc95b58 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Received unexpected event network-vif-plugged-46f42a26-dde5-43b8-a247-c6e8b56a96de for instance with vm_state building and task_state spawning.
Nov 07 15:45:12 user nova-compute[75018]: DEBUG nova.compute.manager [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:45:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:45:12 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Instance spawned successfully.
Nov 07 15:45:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:45:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:45:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:45:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:45:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:45:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:45:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:45:12 user nova-compute[75018]: INFO nova.compute.manager [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 07 15:45:12 user nova-compute[75018]: DEBUG nova.compute.manager [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:45:12 user nova-compute[75018]: INFO nova.compute.manager [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Took 6.76 seconds to build instance.
Nov 07 15:45:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-908707f2-1ac5-413b-810d-3b258e9b5d27 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.874s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:45:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:35 user nova-compute[75018]: INFO nova.compute.manager [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Terminating instance
Nov 07 15:45:35 user nova-compute[75018]: DEBUG nova.compute.manager [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-e0167f7c-082c-485e-a04b-120a4116b72f req-7e068ac8-2f98-416d-b4be-efab7b6326cf service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received event network-vif-unplugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e0167f7c-082c-485e-a04b-120a4116b72f req-7e068ac8-2f98-416d-b4be-efab7b6326cf service nova] Acquiring lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e0167f7c-082c-485e-a04b-120a4116b72f req-7e068ac8-2f98-416d-b4be-efab7b6326cf service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e0167f7c-082c-485e-a04b-120a4116b72f req-7e068ac8-2f98-416d-b4be-efab7b6326cf service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-e0167f7c-082c-485e-a04b-120a4116b72f req-7e068ac8-2f98-416d-b4be-efab7b6326cf service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] No waiting events found dispatching network-vif-unplugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-e0167f7c-082c-485e-a04b-120a4116b72f req-7e068ac8-2f98-416d-b4be-efab7b6326cf service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received event network-vif-unplugged-83dd20e9-5978-4447-b595-18937fab35d5 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:36 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Instance destroyed successfully.
Nov 07 15:45:36 user nova-compute[75018]: DEBUG nova.objects.instance [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lazy-loading 'resources' on Instance uuid da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:38:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-68415212',display_name='tempest-ServerActionsTestOtherA-server-68415212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-68415212',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWUuR4eTrthHIodCYA4J9kJfg+RXJSyXAWybmq/Ac2FttoM8S/nLdDec5RLFtfiG+hcM5DvHo1f+xa7mxv4L56s6Q3dpUvRcBzbdTOGBBvgSiAYU0HY5RSxW2+5w/RcXA==',key_name='tempest-keypair-2049594144',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:41:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-xtwasur4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "83dd20e9-5978-4447-b595-18937fab35d5", "address": "fa:16:3e:a4:c0:dc", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dd20e9-59", "ovs_interfaceid": "83dd20e9-5978-4447-b595-18937fab35d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=83dd20e9-5978-4447-b595-18937fab35d5,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dd20e9-59') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_vif [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=83dd20e9-5978-4447-b595-18937fab35d5,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dd20e9-59') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83dd20e9-59, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17716888-97a3-4680-a88f-84f63faa4fe5) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:45:36 user nova-compute[75018]: INFO os_vif [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=83dd20e9-5978-4447-b595-18937fab35d5,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dd20e9-59')
Nov 07 15:45:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxOItsEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:45:36 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eb6d72-aab4-462d-b725-342836f23662]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:45:36 user nova-compute[75018]: No targets found.
Nov 07 15:45:36 user nova-compute[75018]: iSNS:
Nov 07 15:45:36 user nova-compute[75018]: No targets found.
Nov 07 15:45:36 user nova-compute[75018]: STATIC:
Nov 07 15:45:36 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee
Nov 07 15:45:36 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:45:36 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:45:36 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24
Nov 07 15:45:36 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:45:36 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:45:36 user nova-compute[75018]: FIRMWARE:
Nov 07 15:45:36 user nova-compute[75018]: No targets found.
Nov 07 15:45:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:45:36 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:45:36 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ddaccc-3882-44a1-9dd6-257e4ae0ca8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db2367d-c81d-4b84-9ddb-b0a8df5ea5ce]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:45:36 user nova-compute[75018]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 (non-flash)
Nov 07 15:45:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee (non-flash)
Nov 07 15:45:36 user nova-compute[75018]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 (non-flash)
Nov 07 15:45:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae01fd360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee'): ({'sdg'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Removing single pathed devices sdg {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c1a66b-4034-433c-95a0-41f5d40d4839]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[76508ce9-39a3-46cf-a119-7d8e46999b91]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Flushing IO for device /dev/sdg {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed490fb3-2f00-481c-9777-eaf0e195b4dc]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.081s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfb3553-74b6-454e-882d-27086f238904]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] SCSI volumes sdg have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f291e48e-3bd1-4710-aa83-591db3ae800b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5c8b67-96fb-4781-812b-bc6542b5d777]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260]
Nov 07 15:45:36 user nova-compute[75018]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee, portal: 172.16.0.220,3260] successful.
Nov 07 15:45:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f217d4a6-0a2e-4da7-890e-edb3c57426ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed905cf-c856-4df6-92e3-cb405ebb185a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] <== disconnect_volume: return (350ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:45:36 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Deleting instance files /opt/stack/data/nova/instances/da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb_del
Nov 07 15:45:36 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Deletion of /opt/stack/data/nova/instances/da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb_del complete
Nov 07 15:45:36 user nova-compute[75018]: INFO nova.compute.manager [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 07 15:45:36 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:45:36 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:45:37 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:45:37 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Took 0.77 seconds to deallocate network for instance.
Nov 07 15:45:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-b5df202f-09b5-42c0-9f00-718d0518f71a req-fbcb4690-4280-4cd3-a8ce-c2b5c32ffc31 service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received event network-vif-deleted-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:45:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-3bbe93e8-61fe-4d4b-8db3-d151f5290a37 req-363c06ca-c2cd-41b6-b8f0-298eb80107fe service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received event network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3bbe93e8-61fe-4d4b-8db3-d151f5290a37 req-363c06ca-c2cd-41b6-b8f0-298eb80107fe service nova] Acquiring lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3bbe93e8-61fe-4d4b-8db3-d151f5290a37 req-363c06ca-c2cd-41b6-b8f0-298eb80107fe service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3bbe93e8-61fe-4d4b-8db3-d151f5290a37 req-363c06ca-c2cd-41b6-b8f0-298eb80107fe service nova] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-3bbe93e8-61fe-4d4b-8db3-d151f5290a37 req-363c06ca-c2cd-41b6-b8f0-298eb80107fe service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] No waiting events found dispatching network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:45:37 user nova-compute[75018]: WARNING nova.compute.manager [req-3bbe93e8-61fe-4d4b-8db3-d151f5290a37 req-363c06ca-c2cd-41b6-b8f0-298eb80107fe service nova] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Received unexpected event network-vif-plugged-83dd20e9-5978-4447-b595-18937fab35d5 for instance with vm_state active and task_state deleting.
Nov 07 15:45:38 user nova-compute[75018]: INFO nova.compute.manager [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Took 0.97 seconds to detach 1 volumes for instance.
Nov 07 15:45:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb] Deleting volume: f217d4a6-0a2e-4da7-890e-edb3c57426ee {{(pid=75018) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 07 15:45:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:38 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:45:38 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:45:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:39 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Deleted allocations for instance da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb
Nov 07 15:45:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-57370687-23ac-4ce4-87d9-3c6e0ff75ffb tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "da26c76e-eefb-4d4e-ace9-a2ce4eff7ecb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.812s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:40 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:45:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:45:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:45:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:45:40 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:45:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Updating instance_info_cache with network_info: [{"id": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "address": "fa:16:3e:15:0a:74", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a12c3d-09", "ovs_interfaceid": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:45:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:45:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:45:41 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:45:41 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:45:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:45:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:45:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:45:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:46 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:45:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:46 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:45:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:47 user nova-compute[75018]: INFO nova.compute.manager [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Terminating instance
Nov 07 15:45:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-23020178-8893-47c1-9d76-378a9efc984a req-12b7208b-fd69-413f-b393-ef72cf236df2 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-vif-unplugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-23020178-8893-47c1-9d76-378a9efc984a req-12b7208b-fd69-413f-b393-ef72cf236df2 service nova] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-23020178-8893-47c1-9d76-378a9efc984a req-12b7208b-fd69-413f-b393-ef72cf236df2 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-23020178-8893-47c1-9d76-378a9efc984a req-12b7208b-fd69-413f-b393-ef72cf236df2 service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-23020178-8893-47c1-9d76-378a9efc984a req-12b7208b-fd69-413f-b393-ef72cf236df2 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] No waiting events found dispatching network-vif-unplugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:45:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-23020178-8893-47c1-9d76-378a9efc984a req-12b7208b-fd69-413f-b393-ef72cf236df2 service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-vif-unplugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:48 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Instance destroyed successfully.
Nov 07 15:45:48 user nova-compute[75018]: DEBUG nova.objects.instance [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lazy-loading 'resources' on Instance uuid 626a4817-31f4-48c8-9ab6-07d539dd0a14 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1631876833',display_name='tempest-ServerRescueNegativeTestJSON-server-1631876833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1631876833',id=17,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:32:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374a202b7d114f009ac374762e08c364',ramdisk_id='',reservation_id='r-mh5926va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1476352427',owner_user_name='tempest-ServerRescueNegativeTestJSON-1476352427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:34:38Z,user_data=None,user_id='869a94fcb52246d583be8bac4a722a3c',uuid=626a4817-31f4-48c8-9ab6-07d539dd0a14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converting VIF {"id": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "address": "fa:16:3e:30:3d:00", "network": {"id": "cfb52919-3918-44ea-92df-ff0628005c6c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1215355446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374a202b7d114f009ac374762e08c364", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57442b9-56", "ovs_interfaceid": "f57442b9-562b-4914-80b9-7bc2bf8c8684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=f57442b9-562b-4914-80b9-7bc2bf8c8684,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57442b9-56') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG os_vif [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=f57442b9-562b-4914-80b9-7bc2bf8c8684,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57442b9-56') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf57442b9-56, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f6376f9-a5de-4f20-83b3-fd5a58af3db7) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:45:48 user nova-compute[75018]: INFO os_vif [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=f57442b9-562b-4914-80b9-7bc2bf8c8684,network=Network(cfb52919-3918-44ea-92df-ff0628005c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57442b9-56')
Nov 07 15:45:48 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Deleting instance files /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14_del
Nov 07 15:45:48 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Deletion of /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14_del complete
Nov 07 15:45:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:48 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000011, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/626a4817-31f4-48c8-9ab6-07d539dd0a14/disk
Nov 07 15:45:48 user nova-compute[75018]: INFO nova.compute.manager [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 07 15:45:48 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:45:48 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:45:48 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:45:48 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=7973MB free_disk=24.927600860595703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 626a4817-31f4-48c8-9ab6-07d539dd0a14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 7d054231-82b5-43b0-967a-78f5ef690090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 488821ee-b1f3-4ae2-af06-739901164a6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e542c40d-b3fc-4a79-9777-1d3beaf4a7c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 64559109-6166-488d-a457-20b5f01ddf40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-66039096-110f-4632-86e6-3289d70953f6 req-120f5e94-ef1d-40a3-baea-2b51c5292dd0 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Received event network-changed-cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-66039096-110f-4632-86e6-3289d70953f6 req-120f5e94-ef1d-40a3-baea-2b51c5292dd0 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Refreshing instance network info cache due to event network-changed-cb2849e4-1360-44fe-aae7-c0fececd0cfa. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-66039096-110f-4632-86e6-3289d70953f6 req-120f5e94-ef1d-40a3-baea-2b51c5292dd0 service nova] Acquiring lock "refresh_cache-488821ee-b1f3-4ae2-af06-739901164a6f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-66039096-110f-4632-86e6-3289d70953f6 req-120f5e94-ef1d-40a3-baea-2b51c5292dd0 service nova] Acquired lock "refresh_cache-488821ee-b1f3-4ae2-af06-739901164a6f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.network.neutron [req-66039096-110f-4632-86e6-3289d70953f6 req-120f5e94-ef1d-40a3-baea-2b51c5292dd0 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Refreshing network info cache for port cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:45:49 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Took 1.06 seconds to deallocate network for instance.
Nov 07 15:45:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "488821ee-b1f3-4ae2-af06-739901164a6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "488821ee-b1f3-4ae2-af06-739901164a6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:49 user nova-compute[75018]: INFO nova.compute.manager [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Terminating instance
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.manager [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.network.neutron [req-66039096-110f-4632-86e6-3289d70953f6 req-120f5e94-ef1d-40a3-baea-2b51c5292dd0 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Updated VIF entry in instance network info cache for port cb2849e4-1360-44fe-aae7-c0fececd0cfa. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.network.neutron [req-66039096-110f-4632-86e6-3289d70953f6 req-120f5e94-ef1d-40a3-baea-2b51c5292dd0 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Updating instance_info_cache with network_info: [{"id": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "address": "fa:16:3e:5b:9c:07", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2849e4-13", "ovs_interfaceid": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-66039096-110f-4632-86e6-3289d70953f6 req-120f5e94-ef1d-40a3-baea-2b51c5292dd0 service nova] Releasing lock "refresh_cache-488821ee-b1f3-4ae2-af06-739901164a6f" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-ccaa138b-c74a-4e30-a356-2a75d65d2c07 req-47b54fe0-5ac2-4054-a208-a0ab92ce26ef service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ccaa138b-c74a-4e30-a356-2a75d65d2c07 req-47b54fe0-5ac2-4054-a208-a0ab92ce26ef service nova] Acquiring lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ccaa138b-c74a-4e30-a356-2a75d65d2c07 req-47b54fe0-5ac2-4054-a208-a0ab92ce26ef service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ccaa138b-c74a-4e30-a356-2a75d65d2c07 req-47b54fe0-5ac2-4054-a208-a0ab92ce26ef service nova] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-ccaa138b-c74a-4e30-a356-2a75d65d2c07 req-47b54fe0-5ac2-4054-a208-a0ab92ce26ef service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] No waiting events found dispatching network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:45:49 user nova-compute[75018]: WARNING nova.compute.manager [req-ccaa138b-c74a-4e30-a356-2a75d65d2c07 req-47b54fe0-5ac2-4054-a208-a0ab92ce26ef service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received unexpected event network-vif-plugged-f57442b9-562b-4914-80b9-7bc2bf8c8684 for instance with vm_state deleted and task_state None.
Nov 07 15:45:49 user nova-compute[75018]: DEBUG nova.compute.manager [req-ccaa138b-c74a-4e30-a356-2a75d65d2c07 req-47b54fe0-5ac2-4054-a208-a0ab92ce26ef service nova] [instance: 626a4817-31f4-48c8-9ab6-07d539dd0a14] Received event network-vif-deleted-f57442b9-562b-4914-80b9-7bc2bf8c8684 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:50 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Deleted allocations for instance 626a4817-31f4-48c8-9ab6-07d539dd0a14
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-74817a04-c21c-4069-8e47-9643f13eea69 tempest-ServerRescueNegativeTestJSON-1476352427 tempest-ServerRescueNegativeTestJSON-1476352427-project-member] Lock "626a4817-31f4-48c8-9ab6-07d539dd0a14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.800s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:50 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Instance destroyed successfully.
Nov 07 15:45:50 user nova-compute[75018]: DEBUG nova.objects.instance [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lazy-loading 'resources' on Instance uuid 488821ee-b1f3-4ae2-af06-739901164a6f {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1579723789',display_name='tempest-TestVolumeBootPattern-server-1579723789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1579723789',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOx0I1sXmT3lNlIai/BUHgFfNVaXGOBAGMofft0DNWSqNxYy2hcxiNp28ynq7YoCKdrTjh2gh/Um6LAKOxg2FXW3PmC9v1rI7/vavPxOTEs++uuEyCh9xvBDXbOrVbSjA==',key_name='tempest-TestVolumeBootPattern-157413347',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='772e759d9a1d4d18ae43f53c731f87f2',ramdisk_id='',reservation_id='r-81uw43br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1644595019',owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:44:17Z,user_data=None,user_id='3ae23950e1e84c9693f8098c270ecb55',uuid=488821ee-b1f3-4ae2-af06-739901164a6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "address": "fa:16:3e:5b:9c:07", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2849e4-13", "ovs_interfaceid": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converting VIF {"id": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "address": "fa:16:3e:5b:9c:07", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2849e4-13", "ovs_interfaceid": "cb2849e4-1360-44fe-aae7-c0fececd0cfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:9c:07,bridge_name='br-int',has_traffic_filtering=True,id=cb2849e4-1360-44fe-aae7-c0fececd0cfa,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2849e4-13') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG os_vif [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:9c:07,bridge_name='br-int',has_traffic_filtering=True,id=cb2849e4-1360-44fe-aae7-c0fececd0cfa,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2849e4-13') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb2849e4-13, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bfb8dfc-3675-47e6-815d-e934ce38b759) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:50 user nova-compute[75018]: INFO os_vif [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:9c:07,bridge_name='br-int',has_traffic_filtering=True,id=cb2849e4-1360-44fe-aae7-c0fececd0cfa,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2849e4-13')
Nov 07 15:45:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDJVpavq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:45:50 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:45:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9eff6c-5dd8-4ee0-88c4-2ab5d7889e10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:45:50 user nova-compute[75018]: No targets found.
Nov 07 15:45:50 user nova-compute[75018]: iSNS:
Nov 07 15:45:50 user nova-compute[75018]: No targets found.
Nov 07 15:45:50 user nova-compute[75018]: STATIC:
Nov 07 15:45:50 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24
Nov 07 15:45:50 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:45:50 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:45:50 user nova-compute[75018]: FIRMWARE:
Nov 07 15:45:50 user nova-compute[75018]: No targets found.
Nov 07 15:45:50 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:45:50 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:45:50 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7a3ef9-9592-464a-9339-a4123cffbc1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[313eeea4-0497-47c1-ab05-589b07523571]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 (non-flash)
Nov 07 15:45:50 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 (non-flash)
Nov 07 15:45:50 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feaf82e55a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24'): ({'sdc'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Removing single pathed devices sdc {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[349de780-1f6c-4a65-a869-97335d841b5c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd77250a-1f76-4f5d-9512-786892b8b1af]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Flushing IO for device /dev/sdc {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f430cf-29ab-4733-8ec7-6ec66eb15105]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:45:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.117s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9576d9d-63cb-4445-8ffe-84f8793d9a81]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d9dee9-441b-4a0f-845c-4d9449c95080]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb452f8-79e9-43ed-9ccf-0918deed522b]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24, portal: 172.16.0.220,3260]
Nov 07 15:45:51 user nova-compute[75018]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24, portal: 172.16.0.220,3260] successful.
Nov 07 15:45:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8788460-9f20-4a53-b870-42b87b947f24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0af89f-ca1b-4b1c-bd1e-c68960e03c36]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] <== disconnect_volume: return (406ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:45:51 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Deleting instance files /opt/stack/data/nova/instances/488821ee-b1f3-4ae2-af06-739901164a6f_del
Nov 07 15:45:51 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Deletion of /opt/stack/data/nova/instances/488821ee-b1f3-4ae2-af06-739901164a6f_del complete
Nov 07 15:45:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:51 user nova-compute[75018]: INFO nova.compute.manager [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-cc90002f-caae-4e91-a5fa-5355dd8650e8 req-99dce5ce-7a84-4dba-8fc5-a37e895e6cb6 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Received event network-vif-unplugged-cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cc90002f-caae-4e91-a5fa-5355dd8650e8 req-99dce5ce-7a84-4dba-8fc5-a37e895e6cb6 service nova] Acquiring lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cc90002f-caae-4e91-a5fa-5355dd8650e8 req-99dce5ce-7a84-4dba-8fc5-a37e895e6cb6 service nova] Lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cc90002f-caae-4e91-a5fa-5355dd8650e8 req-99dce5ce-7a84-4dba-8fc5-a37e895e6cb6 service nova] Lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-cc90002f-caae-4e91-a5fa-5355dd8650e8 req-99dce5ce-7a84-4dba-8fc5-a37e895e6cb6 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] No waiting events found dispatching network-vif-unplugged-cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-cc90002f-caae-4e91-a5fa-5355dd8650e8 req-99dce5ce-7a84-4dba-8fc5-a37e895e6cb6 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Received event network-vif-unplugged-cb2849e4-1360-44fe-aae7-c0fececd0cfa for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-cc90002f-caae-4e91-a5fa-5355dd8650e8 req-99dce5ce-7a84-4dba-8fc5-a37e895e6cb6 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Received event network-vif-plugged-cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cc90002f-caae-4e91-a5fa-5355dd8650e8 req-99dce5ce-7a84-4dba-8fc5-a37e895e6cb6 service nova] Acquiring lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cc90002f-caae-4e91-a5fa-5355dd8650e8 req-99dce5ce-7a84-4dba-8fc5-a37e895e6cb6 service nova] Lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cc90002f-caae-4e91-a5fa-5355dd8650e8 req-99dce5ce-7a84-4dba-8fc5-a37e895e6cb6 service nova] Lock "488821ee-b1f3-4ae2-af06-739901164a6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:51 user nova-compute[75018]: DEBUG nova.compute.manager [req-cc90002f-caae-4e91-a5fa-5355dd8650e8 req-99dce5ce-7a84-4dba-8fc5-a37e895e6cb6 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] No waiting events found dispatching network-vif-plugged-cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:45:51 user nova-compute[75018]: WARNING nova.compute.manager [req-cc90002f-caae-4e91-a5fa-5355dd8650e8 req-99dce5ce-7a84-4dba-8fc5-a37e895e6cb6 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Received unexpected event network-vif-plugged-cb2849e4-1360-44fe-aae7-c0fececd0cfa for instance with vm_state active and task_state deleting.
Nov 07 15:45:52 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:45:52 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Took 1.16 seconds to deallocate network for instance.
Nov 07 15:45:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:45:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:52 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:45:52 user nova-compute[75018]: INFO nova.compute.claims [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Claim successful on node user
Nov 07 15:45:53 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:45:53 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:45:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:45:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:45:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:45:53 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:45:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:45:53 user nova-compute[75018]: DEBUG nova.policy [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4927e184ba449c493a60d9580755235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9055a2f9df4fc1867db5de885f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:45:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:45:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:45:53 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Creating image(s)
Nov 07 15:45:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "/opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "/opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "152f08dabc120cf40a68fdac50337888e97430f4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "152f08dabc120cf40a68fdac50337888e97430f4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-7eb3d1c2-8246-4e89-bbad-d5b5cc2286ff req-31be59da-c50e-486c-8409-0b5f94455aa9 service nova] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Received event network-vif-deleted-cb2849e4-1360-44fe-aae7-c0fececd0cfa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:53 user nova-compute[75018]: INFO nova.compute.manager [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 488821ee-b1f3-4ae2-af06-739901164a6f] Took 0.97 seconds to detach 1 volumes for instance.
Nov 07 15:45:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4.part --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Successfully created port: fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4.part --force-share --output=json" returned: 0 in 0.200s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG nova.virt.images [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] cb5b3cf6-9c69-4273-8104-16e4fb6c2f16 was qcow2, converting to raw {{(pid=75018) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4.part /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4.converted {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:54 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Deleted allocations for instance 488821ee-b1f3-4ae2-af06-739901164a6f
Nov 07 15:45:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4.part /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4.converted" returned: 0 in 0.391s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4.converted --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-645d0847-d55c-4ff9-bc6a-b1a94056efe7 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "488821ee-b1f3-4ae2-af06-739901164a6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.833s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "152f08dabc120cf40a68fdac50337888e97430f4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.510s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4 --force-share --output=json" returned: 0 in 0.197s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "152f08dabc120cf40a68fdac50337888e97430f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "152f08dabc120cf40a68fdac50337888e97430f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Successfully updated port: fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquired lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4 --force-share --output=json" returned: 0 in 0.188s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4,backing_fmt=raw /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4,backing_fmt=raw /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk 1073741824" returned: 0 in 0.058s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "152f08dabc120cf40a68fdac50337888e97430f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-1c6aab31-a9f6-45ec-a897-0584a839d365 req-03d41ad9-3c0c-44a4-ac51-0d913a213570 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-changed-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-1c6aab31-a9f6-45ec-a897-0584a839d365 req-03d41ad9-3c0c-44a4-ac51-0d913a213570 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Refreshing instance network info cache due to event network-changed-fba78b12-1ec4-4b48-b972-fabe6eb861cb. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1c6aab31-a9f6-45ec-a897-0584a839d365 req-03d41ad9-3c0c-44a4-ac51-0d913a213570 service nova] Acquiring lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4 --force-share --output=json" returned: 0 in 0.240s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updating instance_info_cache with network_info: [{"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Releasing lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Instance network_info: |[{"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1c6aab31-a9f6-45ec-a897-0584a839d365 req-03d41ad9-3c0c-44a4-ac51-0d913a213570 service nova] Acquired lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.network.neutron [req-1c6aab31-a9f6-45ec-a897-0584a839d365 req-03d41ad9-3c0c-44a4-ac51-0d913a213570 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Refreshing network info cache for port fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Cannot resize image /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Ensure instance console log exists: /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Start _get_guest_xml network_info=[{"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:45:49Z,direct_url=<?>,disk_format='qcow2',id=cb5b3cf6-9c69-4273-8104-16e4fb6c2f16,min_disk=0,min_ram=0,name='tempest-scenario-img--1020993174',owner='1e9055a2f9df4fc1867db5de885f5430',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:45:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cb5b3cf6-9c69-4273-8104-16e4fb6c2f16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:45:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:45:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:45:49Z,direct_url=<?>,disk_format='qcow2',id=cb5b3cf6-9c69-4273-8104-16e4fb6c2f16,min_disk=0,min_ram=0,name='tempest-scenario-img--1020993174',owner='1e9055a2f9df4fc1867db5de885f5430',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:45:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2007259099',display_name='tempest-TestMinimumBasicScenario-server-2007259099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2007259099',id=41,image_ref='cb5b3cf6-9c69-4273-8104-16e4fb6c2f16',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5HG2OdhSPmgIIlNgxbkQ96mEDjXH0cLhbCGyYUW1ZSJYR9IWY1NlFSNWNSR94SssE5COVhVs4rfpnjk/C8eZPku/sBzb/THjU+EqbM57rp2A+oFnjHZA4xyojEOlC9Cw==',key_name='tempest-TestMinimumBasicScenario-1546028479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e9055a2f9df4fc1867db5de885f5430',ramdisk_id='',reservation_id='r-ysspxro3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb5b3cf6-9c69-4273-8104-16e4fb6c2f16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-376924718',owner_user_name='tempest-TestMinimumBasicScenario-376924718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:45:53Z,user_data=None,user_id='d4927e184ba449c493a60d9580755235',uuid=2ffc6cf3-fb96-48b1-9783-6434e107f09e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converting VIF {"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:3f:4c,bridge_name='br-int',has_traffic_filtering=True,id=fba78b12-1ec4-4b48-b972-fabe6eb861cb,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba78b12-1e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ffc6cf3-fb96-48b1-9783-6434e107f09e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:45:55 user nova-compute[75018]:   <uuid>2ffc6cf3-fb96-48b1-9783-6434e107f09e</uuid>
Nov 07 15:45:55 user nova-compute[75018]:   <name>instance-00000029</name>
Nov 07 15:45:55 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:45:55 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:45:55 user nova-compute[75018]:   <metadata>
Nov 07 15:45:55 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:45:55 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:45:55 user nova-compute[75018]:       <nova:name>tempest-TestMinimumBasicScenario-server-2007259099</nova:name>
Nov 07 15:45:55 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:45:55</nova:creationTime>
Nov 07 15:45:55 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:45:55 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:45:55 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:45:55 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:45:55 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:45:55 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:45:55 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:45:55 user nova-compute[75018]:       <nova:owner>
Nov 07 15:45:55 user nova-compute[75018]:         <nova:user uuid="d4927e184ba449c493a60d9580755235">tempest-TestMinimumBasicScenario-376924718-project-member</nova:user>
Nov 07 15:45:55 user nova-compute[75018]:         <nova:project uuid="1e9055a2f9df4fc1867db5de885f5430">tempest-TestMinimumBasicScenario-376924718</nova:project>
Nov 07 15:45:55 user nova-compute[75018]:       </nova:owner>
Nov 07 15:45:55 user nova-compute[75018]:       <nova:root type="image" uuid="cb5b3cf6-9c69-4273-8104-16e4fb6c2f16"/>
Nov 07 15:45:55 user nova-compute[75018]:       <nova:ports>
Nov 07 15:45:55 user nova-compute[75018]:         <nova:port uuid="fba78b12-1ec4-4b48-b972-fabe6eb861cb">
Nov 07 15:45:55 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 07 15:45:55 user nova-compute[75018]:         </nova:port>
Nov 07 15:45:55 user nova-compute[75018]:       </nova:ports>
Nov 07 15:45:55 user nova-compute[75018]:     </nova:instance>
Nov 07 15:45:55 user nova-compute[75018]:   </metadata>
Nov 07 15:45:55 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:45:55 user nova-compute[75018]:     <system>
Nov 07 15:45:55 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:45:55 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:45:55 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:45:55 user nova-compute[75018]:       <entry name="serial">2ffc6cf3-fb96-48b1-9783-6434e107f09e</entry>
Nov 07 15:45:55 user nova-compute[75018]:       <entry name="uuid">2ffc6cf3-fb96-48b1-9783-6434e107f09e</entry>
Nov 07 15:45:55 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:45:55 user nova-compute[75018]:     </system>
Nov 07 15:45:55 user nova-compute[75018]:   </sysinfo>
Nov 07 15:45:55 user nova-compute[75018]:   <os>
Nov 07 15:45:55 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:45:55 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:45:55 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:45:55 user nova-compute[75018]:   </os>
Nov 07 15:45:55 user nova-compute[75018]:   <features>
Nov 07 15:45:55 user nova-compute[75018]:     <acpi/>
Nov 07 15:45:55 user nova-compute[75018]:     <apic/>
Nov 07 15:45:55 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:45:55 user nova-compute[75018]:   </features>
Nov 07 15:45:55 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:45:55 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:45:55 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:45:55 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:45:55 user nova-compute[75018]:   </clock>
Nov 07 15:45:55 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:45:55 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:45:55 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:45:55 user nova-compute[75018]:   </cpu>
Nov 07 15:45:55 user nova-compute[75018]:   <devices>
Nov 07 15:45:55 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:45:55 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:45:55 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk"/>
Nov 07 15:45:55 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:45:55 user nova-compute[75018]:     </disk>
Nov 07 15:45:55 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:45:55 user nova-compute[75018]:       <mac address="fa:16:3e:e3:3f:4c"/>
Nov 07 15:45:55 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:45:55 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:45:55 user nova-compute[75018]:       <target dev="tapfba78b12-1e"/>
Nov 07 15:45:55 user nova-compute[75018]:     </interface>
Nov 07 15:45:55 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:45:55 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/console.log" append="off"/>
Nov 07 15:45:55 user nova-compute[75018]:     </serial>
Nov 07 15:45:55 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:45:55 user nova-compute[75018]:     <video>
Nov 07 15:45:55 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:45:55 user nova-compute[75018]:     </video>
Nov 07 15:45:55 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:45:55 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:45:55 user nova-compute[75018]:     </rng>
Nov 07 15:45:55 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:45:55 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:45:55 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:45:55 user nova-compute[75018]:     </memballoon>
Nov 07 15:45:55 user nova-compute[75018]:   </devices>
Nov 07 15:45:55 user nova-compute[75018]: </domain>
Nov 07 15:45:55 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2007259099',display_name='tempest-TestMinimumBasicScenario-server-2007259099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2007259099',id=41,image_ref='cb5b3cf6-9c69-4273-8104-16e4fb6c2f16',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5HG2OdhSPmgIIlNgxbkQ96mEDjXH0cLhbCGyYUW1ZSJYR9IWY1NlFSNWNSR94SssE5COVhVs4rfpnjk/C8eZPku/sBzb/THjU+EqbM57rp2A+oFnjHZA4xyojEOlC9Cw==',key_name='tempest-TestMinimumBasicScenario-1546028479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e9055a2f9df4fc1867db5de885f5430',ramdisk_id='',reservation_id='r-ysspxro3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb5b3cf6-9c69-4273-8104-16e4fb6c2f16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-376924718',owner_user_name='tempest-TestMinimumBasicScenario-376924718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:45:53Z,user_data=None,user_id='d4927e184ba449c493a60d9580755235',uuid=2ffc6cf3-fb96-48b1-9783-6434e107f09e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converting VIF {"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:3f:4c,bridge_name='br-int',has_traffic_filtering=True,id=fba78b12-1ec4-4b48-b972-fabe6eb861cb,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba78b12-1e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG os_vif [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:3f:4c,bridge_name='br-int',has_traffic_filtering=True,id=fba78b12-1ec4-4b48-b972-fabe6eb861cb,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba78b12-1e') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e99539ea-af2e-5f81-bfc4-356e1f11c784', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfba78b12-1e, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfba78b12-1e, col_values=(('qos', UUID('d6b2d152-0cb0-4ca2-9ab8-7ebe09e66096')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfba78b12-1e, col_values=(('external_ids', {'iface-id': 'fba78b12-1ec4-4b48-b972-fabe6eb861cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:3f:4c', 'vm-uuid': '2ffc6cf3-fb96-48b1-9783-6434e107f09e'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:45:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:55 user nova-compute[75018]: INFO os_vif [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:3f:4c,bridge_name='br-int',has_traffic_filtering=True,id=fba78b12-1ec4-4b48-b972-fabe6eb861cb,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba78b12-1e')
Nov 07 15:45:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:45:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] No VIF found with MAC fa:16:3e:e3:3f:4c, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:45:56 user nova-compute[75018]: DEBUG nova.network.neutron [req-1c6aab31-a9f6-45ec-a897-0584a839d365 req-03d41ad9-3c0c-44a4-ac51-0d913a213570 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updated VIF entry in instance network info cache for port fba78b12-1ec4-4b48-b972-fabe6eb861cb. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:45:56 user nova-compute[75018]: DEBUG nova.network.neutron [req-1c6aab31-a9f6-45ec-a897-0584a839d365 req-03d41ad9-3c0c-44a4-ac51-0d913a213570 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updating instance_info_cache with network_info: [{"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:45:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1c6aab31-a9f6-45ec-a897-0584a839d365 req-03d41ad9-3c0c-44a4-ac51-0d913a213570 service nova] Releasing lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:45:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-47e45817-027f-432a-8c16-ed4ffacc4a7a req-0e94c81f-8289-4280-8955-f96c06a97a06 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-47e45817-027f-432a-8c16-ed4ffacc4a7a req-0e94c81f-8289-4280-8955-f96c06a97a06 service nova] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-47e45817-027f-432a-8c16-ed4ffacc4a7a req-0e94c81f-8289-4280-8955-f96c06a97a06 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-47e45817-027f-432a-8c16-ed4ffacc4a7a req-0e94c81f-8289-4280-8955-f96c06a97a06 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-47e45817-027f-432a-8c16-ed4ffacc4a7a req-0e94c81f-8289-4280-8955-f96c06a97a06 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] No waiting events found dispatching network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:45:57 user nova-compute[75018]: WARNING nova.compute.manager [req-47e45817-027f-432a-8c16-ed4ffacc4a7a req-0e94c81f-8289-4280-8955-f96c06a97a06 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received unexpected event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb for instance with vm_state building and task_state spawning.
Nov 07 15:45:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:45:59 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:45:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:45:59 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Instance spawned successfully.
Nov 07 15:45:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:45:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:45:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:45:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:45:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:45:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:45:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:45:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-ab509e05-3afb-4f37-b3f9-ac1ca3aad53d req-221fa904-53bb-485b-bcfd-fde71da34e52 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:45:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ab509e05-3afb-4f37-b3f9-ac1ca3aad53d req-221fa904-53bb-485b-bcfd-fde71da34e52 service nova] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:45:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ab509e05-3afb-4f37-b3f9-ac1ca3aad53d req-221fa904-53bb-485b-bcfd-fde71da34e52 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:45:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ab509e05-3afb-4f37-b3f9-ac1ca3aad53d req-221fa904-53bb-485b-bcfd-fde71da34e52 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:45:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-ab509e05-3afb-4f37-b3f9-ac1ca3aad53d req-221fa904-53bb-485b-bcfd-fde71da34e52 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] No waiting events found dispatching network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:45:59 user nova-compute[75018]: WARNING nova.compute.manager [req-ab509e05-3afb-4f37-b3f9-ac1ca3aad53d req-221fa904-53bb-485b-bcfd-fde71da34e52 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received unexpected event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb for instance with vm_state building and task_state spawning.
Nov 07 15:45:59 user nova-compute[75018]: INFO nova.compute.manager [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Took 6.40 seconds to spawn the instance on the hypervisor.
Nov 07 15:45:59 user nova-compute[75018]: DEBUG nova.compute.manager [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:45:59 user nova-compute[75018]: INFO nova.compute.manager [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Took 7.10 seconds to build instance.
Nov 07 15:45:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f85abbaf-5e3b-4859-9b59-076f6e66d134 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.200s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:46:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-1fa7eecd-4f34-4dff-8208-3bdff775e024 req-d5002e87-ce3d-4a0f-84d1-df4dd94745d1 service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Received event network-changed-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG nova.compute.manager [req-1fa7eecd-4f34-4dff-8208-3bdff775e024 req-d5002e87-ce3d-4a0f-84d1-df4dd94745d1 service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Refreshing instance network info cache due to event network-changed-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1fa7eecd-4f34-4dff-8208-3bdff775e024 req-d5002e87-ce3d-4a0f-84d1-df4dd94745d1 service nova] Acquiring lock "refresh_cache-e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1fa7eecd-4f34-4dff-8208-3bdff775e024 req-d5002e87-ce3d-4a0f-84d1-df4dd94745d1 service nova] Acquired lock "refresh_cache-e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG nova.network.neutron [req-1fa7eecd-4f34-4dff-8208-3bdff775e024 req-d5002e87-ce3d-4a0f-84d1-df4dd94745d1 service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Refreshing network info cache for port 45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG nova.network.neutron [req-1fa7eecd-4f34-4dff-8208-3bdff775e024 req-d5002e87-ce3d-4a0f-84d1-df4dd94745d1 service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Updated VIF entry in instance network info cache for port 45d3ffca-a4ed-4973-8ce0-9a077f3f59fa. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG nova.network.neutron [req-1fa7eecd-4f34-4dff-8208-3bdff775e024 req-d5002e87-ce3d-4a0f-84d1-df4dd94745d1 service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Updating instance_info_cache with network_info: [{"id": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "address": "fa:16:3e:19:37:39", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d3ffca-a4", "ovs_interfaceid": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1fa7eecd-4f34-4dff-8208-3bdff775e024 req-d5002e87-ce3d-4a0f-84d1-df4dd94745d1 service nova] Releasing lock "refresh_cache-e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lazy-loading 'flavor' on Instance uuid e542c40d-b3fc-4a79-9777-1d3beaf4a7c3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:46:05 user nova-compute[75018]: INFO nova.compute.manager [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Attaching volume 586ca1ee-8007-4396-acbc-0ae5f69c11fb to /dev/vdb
Nov 07 15:46:05 user nova-compute[75018]: DEBUG os_brick.utils [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ad4c4c-af2e-47c4-890d-226f4e57703e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1f89d9-a7a7-4741-b8c4-bc856fc81fdc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e79e1e-983a-4501-a412-0bbad7dfb072]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b26fe2d-d41b-430f-ac90-210dec6b19d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:46:05 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:46:05 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e557504e-5801-4ef8-99b1-ffd1c78d59ea]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG os_brick.utils [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:46:05 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Updating existing volume attachment record: 29041d92-66e1-46b3-981c-89b600c9c223 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:46:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJBYHdPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:46:27 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:46:27 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:46:27 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de31e2f-2d0c-4465-8df0-a59facf93b11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:46:27 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7156ec61-a9a8-4178-af17-8a7933148d9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb] added
Nov 07 15:46:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[977c77f2-5969-4550-8754-c5877fa7ee9c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb759b92-280e-44b6-8fc8-c0cb71ae3655]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJBYHdPe {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJBYHdPe" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf5b8a5-1757-4d37-9273-ad34f7bc6047]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LJBYHdPe'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4767250e-05bc-4467-8113-7f8d251700cb]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbe757b-504c-4c2b-9721-7bae562d461d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 15:46:27 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 15:46:27 user nova-compute[75018]:  {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:46:27 user nova-compute[75018]: WARNING os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 15:46:27 user nova-compute[75018]: 
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a657d52-3ab1-42c7-b1d3-4b97fa428f54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb, portal: 172.16.0.220,3260]
Nov 07 15:46:27 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb, portal: 172.16.0.220,3260] successful.
Nov 07 15:46:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88bea8d-c937-42dc-ba40-53642b705c09]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4de9054-ba2b-448f-90a0-6baf93595945]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb (non-flash)
Nov 07 15:46:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb (non-flash)
Nov 07 15:46:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fc0bf5-b15e-4696-8c66-b64cc43bdcbb]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:46:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJBYHdPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:46:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:46:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23034343335316436', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:46:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034343335316436', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:46:28 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lazy-loading 'flavor' on Instance uuid e542c40d-b3fc-4a79-9777-1d3beaf4a7c3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:46:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:46:28 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:46:28 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 15:46:28 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:46:28 user nova-compute[75018]:   <serial>586ca1ee-8007-4396-acbc-0ae5f69c11fb</serial>
Nov 07 15:46:28 user nova-compute[75018]: </disk>
Nov 07 15:46:28 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:46:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:46:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:46:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] No VIF found with MAC fa:16:3e:19:37:39, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:46:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c0044432-3105-4ac0-9913-b32e7ae06951 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.289s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:46:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:46:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:46:30 user nova-compute[75018]: INFO nova.compute.manager [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Detaching volume 586ca1ee-8007-4396-acbc-0ae5f69c11fb
Nov 07 15:46:30 user nova-compute[75018]: INFO nova.virt.block_device [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Attempting to driver detach volume 586ca1ee-8007-4396-acbc-0ae5f69c11fb from mountpoint /dev/vdb
Nov 07 15:46:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Attempting to detach device vdb from instance e542c40d-b3fc-4a79-9777-1d3beaf4a7c3 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:46:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:46:30 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:46:30 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 15:46:30 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:46:30 user nova-compute[75018]:   <serial>586ca1ee-8007-4396-acbc-0ae5f69c11fb</serial>
Nov 07 15:46:30 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:46:30 user nova-compute[75018]: </disk>
Nov 07 15:46:30 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:46:30 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Successfully detached device vdb from instance e542c40d-b3fc-4a79-9777-1d3beaf4a7c3 from the persistent domain config.
Nov 07 15:46:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e542c40d-b3fc-4a79-9777-1d3beaf4a7c3 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:46:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:46:30 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:46:30 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 15:46:30 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:46:30 user nova-compute[75018]:   <serial>586ca1ee-8007-4396-acbc-0ae5f69c11fb</serial>
Nov 07 15:46:30 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:46:30 user nova-compute[75018]: </disk>
Nov 07 15:46:30 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:46:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e542c40d-b3fc-4a79-9777-1d3beaf4a7c3 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:46:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] There are 0 instances to clean {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "0e508411-09db-48b8-98a5-1ccd9f4f6031" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:46:36 user nova-compute[75018]: INFO nova.compute.manager [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Terminating instance
Nov 07 15:46:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-4e719965-894b-4b72-ba8d-e7c50f1b256c req-33dff281-a1cf-469c-8125-896796956968 service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Received event network-vif-unplugged-88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4e719965-894b-4b72-ba8d-e7c50f1b256c req-33dff281-a1cf-469c-8125-896796956968 service nova] Acquiring lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4e719965-894b-4b72-ba8d-e7c50f1b256c req-33dff281-a1cf-469c-8125-896796956968 service nova] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4e719965-894b-4b72-ba8d-e7c50f1b256c req-33dff281-a1cf-469c-8125-896796956968 service nova] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-4e719965-894b-4b72-ba8d-e7c50f1b256c req-33dff281-a1cf-469c-8125-896796956968 service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] No waiting events found dispatching network-vif-unplugged-88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG nova.compute.manager [req-4e719965-894b-4b72-ba8d-e7c50f1b256c req-33dff281-a1cf-469c-8125-896796956968 service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Received event network-vif-unplugged-88ce52b1-c8b7-4958-ad77-4424811b13b6 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:37 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Instance destroyed successfully.
Nov 07 15:46:37 user nova-compute[75018]: DEBUG nova.objects.instance [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lazy-loading 'resources' on Instance uuid 0e508411-09db-48b8-98a5-1ccd9f4f6031 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:26:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-409192157',display_name='tempest-ServerActionsTestOtherA-server-409192157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-409192157',id=15,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWUuR4eTrthHIodCYA4J9kJfg+RXJSyXAWybmq/Ac2FttoM8S/nLdDec5RLFtfiG+hcM5DvHo1f+xa7mxv4L56s6Q3dpUvRcBzbdTOGBBvgSiAYU0HY5RSxW2+5w/RcXA==',key_name='tempest-keypair-2049594144',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:26:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8da5c809b9e14547855ac986915e8c99',ramdisk_id='',reservation_id='r-skbl9h5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1198683339',owner_user_name='tempest-ServerActionsTestOtherA-1198683339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:26:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b39ca6e2db4be9a71fca8389bce83f',uuid=0e508411-09db-48b8-98a5-1ccd9f4f6031,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converting VIF {"id": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "address": "fa:16:3e:d3:ab:e0", "network": {"id": "837c4b73-8705-44c8-9f3e-c2f34b6a5734", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-259037608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da5c809b9e14547855ac986915e8c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ce52b1-c8", "ovs_interfaceid": "88ce52b1-c8b7-4958-ad77-4424811b13b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ab:e0,bridge_name='br-int',has_traffic_filtering=True,id=88ce52b1-c8b7-4958-ad77-4424811b13b6,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ce52b1-c8') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG os_vif [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ab:e0,bridge_name='br-int',has_traffic_filtering=True,id=88ce52b1-c8b7-4958-ad77-4424811b13b6,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ce52b1-c8') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88ce52b1-c8, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fdd1641-139d-4839-892c-81b212440cb7) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:37 user nova-compute[75018]: INFO os_vif [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ab:e0,bridge_name='br-int',has_traffic_filtering=True,id=88ce52b1-c8b7-4958-ad77-4424811b13b6,network=Network(837c4b73-8705-44c8-9f3e-c2f34b6a5734),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ce52b1-c8')
Nov 07 15:46:37 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Deleting instance files /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031_del
Nov 07 15:46:37 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Deletion of /opt/stack/data/nova/instances/0e508411-09db-48b8-98a5-1ccd9f4f6031_del complete
Nov 07 15:46:37 user nova-compute[75018]: INFO nova.compute.manager [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 07 15:46:37 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:46:37 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:46:38 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:46:38 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Took 0.48 seconds to deallocate network for instance.
Nov 07 15:46:38 user nova-compute[75018]: DEBUG nova.compute.manager [req-de5fc0f0-1d87-403d-a1d9-c077c160373f req-fd54c28a-3e62-4645-968b-c2498501347b service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Received event network-vif-deleted-88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:46:38 user nova-compute[75018]: INFO nova.compute.manager [req-de5fc0f0-1d87-403d-a1d9-c077c160373f req-fd54c28a-3e62-4645-968b-c2498501347b service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Neutron deleted interface 88ce52b1-c8b7-4958-ad77-4424811b13b6; detaching it from the instance and deleting it from the info cache
Nov 07 15:46:38 user nova-compute[75018]: DEBUG nova.network.neutron [req-de5fc0f0-1d87-403d-a1d9-c077c160373f req-fd54c28a-3e62-4645-968b-c2498501347b service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:46:38 user nova-compute[75018]: DEBUG nova.compute.manager [req-de5fc0f0-1d87-403d-a1d9-c077c160373f req-fd54c28a-3e62-4645-968b-c2498501347b service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Detach interface failed, port_id=88ce52b1-c8b7-4958-ad77-4424811b13b6, reason: Instance 0e508411-09db-48b8-98a5-1ccd9f4f6031 could not be found. {{(pid=75018) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 15:46:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:46:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:46:38 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:46:38 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:46:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:46:38 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Deleted allocations for instance 0e508411-09db-48b8-98a5-1ccd9f4f6031
Nov 07 15:46:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-575afa8a-21eb-4248-9a95-fac19247074f tempest-ServerActionsTestOtherA-1198683339 tempest-ServerActionsTestOtherA-1198683339-project-member] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.836s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:46:38 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:46:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-9953fe70-0cee-4d29-b244-22f0482077bd req-1c2998fb-70e1-47d0-8ec3-239378176fb5 service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Received event network-vif-plugged-88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:46:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9953fe70-0cee-4d29-b244-22f0482077bd req-1c2998fb-70e1-47d0-8ec3-239378176fb5 service nova] Acquiring lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:46:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9953fe70-0cee-4d29-b244-22f0482077bd req-1c2998fb-70e1-47d0-8ec3-239378176fb5 service nova] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:46:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9953fe70-0cee-4d29-b244-22f0482077bd req-1c2998fb-70e1-47d0-8ec3-239378176fb5 service nova] Lock "0e508411-09db-48b8-98a5-1ccd9f4f6031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:46:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-9953fe70-0cee-4d29-b244-22f0482077bd req-1c2998fb-70e1-47d0-8ec3-239378176fb5 service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] No waiting events found dispatching network-vif-plugged-88ce52b1-c8b7-4958-ad77-4424811b13b6 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:46:39 user nova-compute[75018]: WARNING nova.compute.manager [req-9953fe70-0cee-4d29-b244-22f0482077bd req-1c2998fb-70e1-47d0-8ec3-239378176fb5 service nova] [instance: 0e508411-09db-48b8-98a5-1ccd9f4f6031] Received unexpected event network-vif-plugged-88ce52b1-c8b7-4958-ad77-4424811b13b6 for instance with vm_state deleted and task_state None.
Nov 07 15:46:40 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:46:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:46:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 15:46:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:46:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:46:40 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:46:40 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid 7d054231-82b5-43b0-967a-78f5ef690090 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:46:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Updating instance_info_cache with network_info: [{"id": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "address": "fa:16:3e:15:0a:74", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a12c3d-09", "ovs_interfaceid": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:46:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:46:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:46:41 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:46:41 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:46:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:46:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "9d35d8fc-9565-407f-b76b-d7e30df2fc02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:46:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "9d35d8fc-9565-407f-b76b-d7e30df2fc02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:46:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:46:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:46:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:46:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:46:41 user nova-compute[75018]: INFO nova.compute.claims [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Claim successful on node user
Nov 07 15:46:42 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG nova.compute.manager [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG nova.compute.manager [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG nova.network.neutron [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:46:42 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:46:42 user nova-compute[75018]: DEBUG nova.compute.manager [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG nova.policy [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ae23950e1e84c9693f8098c270ecb55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772e759d9a1d4d18ae43f53c731f87f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:46:42 user nova-compute[75018]: INFO nova.virt.block_device [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Booting with volume d8788460-9f20-4a53-b870-42b87b947f24 at /dev/vda
Nov 07 15:46:42 user nova-compute[75018]: DEBUG os_brick.utils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5c652b-ed83-4922-af19-d2a23c3942fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[541c80c3-aaa2-49f3-b5c3-e653f84e0619]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[07649bf9-93d0-4862-b0d2-515e8c888781]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaca429-7bb2-42ff-bf84-428119a0f69a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:46:42 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:46:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b5d3ef-b68d-4a5e-a3a9-4431ffb39e8f]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG os_brick.utils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:46:42 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Updating existing volume attachment record: bffc2e40-d64c-4996-b5a7-1e71f4e98e7d {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:46:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Successfully created port: 879e6a77-5bee-4552-8feb-d870a4cdbd60 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:46:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Successfully updated port: 879e6a77-5bee-4552-8feb-d870a4cdbd60 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:46:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "refresh_cache-9d35d8fc-9565-407f-b76b-d7e30df2fc02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:46:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquired lock "refresh_cache-9d35d8fc-9565-407f-b76b-d7e30df2fc02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:46:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:46:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-1c7402e1-5efc-4601-a719-ad2019bca3d4 req-11c6b13c-db6c-431a-b7b2-8c7327cd9192 service nova] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Received event network-changed-879e6a77-5bee-4552-8feb-d870a4cdbd60 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:46:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-1c7402e1-5efc-4601-a719-ad2019bca3d4 req-11c6b13c-db6c-431a-b7b2-8c7327cd9192 service nova] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Refreshing instance network info cache due to event network-changed-879e6a77-5bee-4552-8feb-d870a4cdbd60. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:46:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1c7402e1-5efc-4601-a719-ad2019bca3d4 req-11c6b13c-db6c-431a-b7b2-8c7327cd9192 service nova] Acquiring lock "refresh_cache-9d35d8fc-9565-407f-b76b-d7e30df2fc02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:46:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:46:44 user nova-compute[75018]: DEBUG nova.network.neutron [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Updating instance_info_cache with network_info: [{"id": "879e6a77-5bee-4552-8feb-d870a4cdbd60", "address": "fa:16:3e:9c:d3:8f", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879e6a77-5b", "ovs_interfaceid": "879e6a77-5bee-4552-8feb-d870a4cdbd60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:46:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Releasing lock "refresh_cache-9d35d8fc-9565-407f-b76b-d7e30df2fc02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:46:44 user nova-compute[75018]: DEBUG nova.compute.manager [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Instance network_info: |[{"id": "879e6a77-5bee-4552-8feb-d870a4cdbd60", "address": "fa:16:3e:9c:d3:8f", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879e6a77-5b", "ovs_interfaceid": "879e6a77-5bee-4552-8feb-d870a4cdbd60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:46:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1c7402e1-5efc-4601-a719-ad2019bca3d4 req-11c6b13c-db6c-431a-b7b2-8c7327cd9192 service nova] Acquired lock "refresh_cache-9d35d8fc-9565-407f-b76b-d7e30df2fc02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:46:44 user nova-compute[75018]: DEBUG nova.network.neutron [req-1c7402e1-5efc-4601-a719-ad2019bca3d4 req-11c6b13c-db6c-431a-b7b2-8c7327cd9192 service nova] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Refreshing network info cache for port 879e6a77-5bee-4552-8feb-d870a4cdbd60 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:46:44 user nova-compute[75018]: DEBUG nova.network.neutron [req-1c7402e1-5efc-4601-a719-ad2019bca3d4 req-11c6b13c-db6c-431a-b7b2-8c7327cd9192 service nova] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Updated VIF entry in instance network info cache for port 879e6a77-5bee-4552-8feb-d870a4cdbd60. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:46:44 user nova-compute[75018]: DEBUG nova.network.neutron [req-1c7402e1-5efc-4601-a719-ad2019bca3d4 req-11c6b13c-db6c-431a-b7b2-8c7327cd9192 service nova] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Updating instance_info_cache with network_info: [{"id": "879e6a77-5bee-4552-8feb-d870a4cdbd60", "address": "fa:16:3e:9c:d3:8f", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879e6a77-5b", "ovs_interfaceid": "879e6a77-5bee-4552-8feb-d870a4cdbd60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:46:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1c7402e1-5efc-4601-a719-ad2019bca3d4 req-11c6b13c-db6c-431a-b7b2-8c7327cd9192 service nova] Releasing lock "refresh_cache-9d35d8fc-9565-407f-b76b-d7e30df2fc02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:46:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:46:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:46:45 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:46:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:46:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:46:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:46:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:46:47 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:46:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:47 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:48 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:49 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:46:49 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:46:49 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8274MB free_disk=24.890830993652344GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:46:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:46:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 7d054231-82b5-43b0-967a-78f5ef690090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance e542c40d-b3fc-4a79-9777-1d3beaf4a7c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 64559109-6166-488d-a457-20b5f01ddf40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 2ffc6cf3-fb96-48b1-9783-6434e107f09e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 9d35d8fc-9565-407f-b76b-d7e30df2fc02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing inventories for resource provider 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating ProviderTree inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing aggregate associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, aggregates: None {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing trait associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.747s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:46:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75018) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 15:46:51 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e542c40d-b3fc-4a79-9777-1d3beaf4a7c3 is timed out.
Nov 07 15:46:51 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Successfully detached device vdb from instance e542c40d-b3fc-4a79-9777-1d3beaf4a7c3 from the live domain config.
Nov 07 15:46:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJBYHdPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:46:51 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5afbef-552a-4f8e-bd34-65a7136a68f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:46:51 user nova-compute[75018]: No targets found.
Nov 07 15:46:51 user nova-compute[75018]: iSNS:
Nov 07 15:46:51 user nova-compute[75018]: No targets found.
Nov 07 15:46:51 user nova-compute[75018]: STATIC:
Nov 07 15:46:51 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb
Nov 07 15:46:51 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:46:51 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:46:51 user nova-compute[75018]: FIRMWARE:
Nov 07 15:46:51 user nova-compute[75018]: No targets found.
Nov 07 15:46:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:46:51 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:46:51 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaafc411-6dd0-4156-8959-6790ee47954b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca2be65-906d-4b80-b21d-1bd87cd2befa]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb (non-flash)
Nov 07 15:46:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb (non-flash)
Nov 07 15:46:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb001f95a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[197f9d03-22e2-475c-9505-a0432c4d906d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d929931-29fc-4e52-b7f0-4b7d41b8866c]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a82cd0f-8d71-4ff6-baf0-883b2c620442]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[157dc160-c4d4-4abc-ba21-e4aa87955e7a]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecff2d96-8da4-419f-b5e1-a1ad16ffd5d0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[98368f9c-7fb3-4f4e-be6d-6aa2ade3a383]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb, portal: 172.16.0.220,3260]
Nov 07 15:46:51 user nova-compute[75018]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb, portal: 172.16.0.220,3260] successful.
Nov 07 15:46:51 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586ca1ee-8007-4396-acbc-0ae5f69c11fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4432110-7b42-4c07-a309-9c0d44b38c9a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] <== disconnect_volume: return (341ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:46:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:46:52 user nova-compute[75018]: DEBUG nova.objects.instance [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lazy-loading 'flavor' on Instance uuid e542c40d-b3fc-4a79-9777-1d3beaf4a7c3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:46:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-f5a5c851-5d12-4a6c-b5a0-0fd64e496810 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.835s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:46:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.volume.cinder [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Update attachment failed for attachment bffc2e40-d64c-4996-b5a7-1e71f4e98e7d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7b9ef4c6-44f3-49e2-bb36-5112446be945) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7b9ef4c6-44f3-49e2-bb36-5112446be945)
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7b9ef4c6-44f3-49e2-bb36-5112446be945)
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Traceback (most recent call last):
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     driver_block_device.attach_block_devices(
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     _log_and_attach(device)
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     bdm.attach(*attach_args, **attach_kwargs)
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     ret_val = method(obj, context, *args, **kwargs)
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     self._do_attach(context, instance, volume, volume_api,
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     self._volume_attach(context, volume, connector, instance,
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     connection_info = volume_api.attachment_update(
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     res = method(self, ctx, *args, **kwargs)
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     with excutils.save_and_reraise_exception():
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     self.force_reraise()
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     raise self.value
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     context, '3.44', skip_version_check=True).attachments.update(
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     return method.func(obj, *args, **kwargs)
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     resp = self._update('/attachments/%s' % id, body)
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     return self._cs_request(url, 'PUT', **kwargs)
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     return self.request(url, method, **kwargs)
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02]     raise exceptions.from_response(resp, body)
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7b9ef4c6-44f3-49e2-bb36-5112446be945)
Nov 07 15:46:52 user nova-compute[75018]: ERROR nova.compute.manager [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] 
Nov 07 15:46:52 user nova-compute[75018]: DEBUG nova.compute.claims [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Aborting claim: <nova.compute.claims.Claim object at 0x7feaf835a680> {{(pid=75018) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 07 15:46:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:46:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.274s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Build of instance 9d35d8fc-9565-407f-b76b-d7e30df2fc02 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7b9ef4c6-44f3-49e2-bb36-5112446be945) {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG nova.compute.utils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Build of instance 9d35d8fc-9565-407f-b76b-d7e30df2fc02 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75018) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 07 15:46:53 user nova-compute[75018]: ERROR nova.compute.manager [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Build of instance 9d35d8fc-9565-407f-b76b-d7e30df2fc02 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7b9ef4c6-44f3-49e2-bb36-5112446be945): nova.exception.BuildAbortException: Build of instance 9d35d8fc-9565-407f-b76b-d7e30df2fc02 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7b9ef4c6-44f3-49e2-bb36-5112446be945)
Nov 07 15:46:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Unplugging VIFs for instance {{(pid=75018) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2111054028',display_name='tempest-TestVolumeBootPattern-server-2111054028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2111054028',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOx0I1sXmT3lNlIai/BUHgFfNVaXGOBAGMofft0DNWSqNxYy2hcxiNp28ynq7YoCKdrTjh2gh/Um6LAKOxg2FXW3PmC9v1rI7/vavPxOTEs++uuEyCh9xvBDXbOrVbSjA==',key_name='tempest-TestVolumeBootPattern-157413347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772e759d9a1d4d18ae43f53c731f87f2',ramdisk_id='',reservation_id='r-27ksk4l9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1644595019',owner_user_name='tempest-TestVolumeBootPattern-1644595019-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:46:42Z,user_data=None,user_id='3ae23950e1e84c9693f8098c270ecb55',uuid=9d35d8fc-9565-407f-b76b-d7e30df2fc02,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "879e6a77-5bee-4552-8feb-d870a4cdbd60", "address": "fa:16:3e:9c:d3:8f", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879e6a77-5b", "ovs_interfaceid": "879e6a77-5bee-4552-8feb-d870a4cdbd60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converting VIF {"id": "879e6a77-5bee-4552-8feb-d870a4cdbd60", "address": "fa:16:3e:9c:d3:8f", "network": {"id": "90d602a8-a555-4a9e-97e0-1fe16b1f83d5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2050147018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772e759d9a1d4d18ae43f53c731f87f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879e6a77-5b", "ovs_interfaceid": "879e6a77-5bee-4552-8feb-d870a4cdbd60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:d3:8f,bridge_name='br-int',has_traffic_filtering=True,id=879e6a77-5bee-4552-8feb-d870a4cdbd60,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap879e6a77-5b') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG os_vif [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:d3:8f,bridge_name='br-int',has_traffic_filtering=True,id=879e6a77-5bee-4552-8feb-d870a4cdbd60,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap879e6a77-5b') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap879e6a77-5b, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:46:53 user nova-compute[75018]: INFO os_vif [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:d3:8f,bridge_name='br-int',has_traffic_filtering=True,id=879e6a77-5bee-4552-8feb-d870a4cdbd60,network=Network(90d602a8-a555-4a9e-97e0-1fe16b1f83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap879e6a77-5b')
Nov 07 15:46:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Unplugged VIFs for instance {{(pid=75018) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:46:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:46:53 user nova-compute[75018]: INFO nova.compute.manager [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Took 0.72 seconds to deallocate network for instance.
Nov 07 15:46:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Detaching volume: d8788460-9f20-4a53-b870-42b87b947f24 {{(pid=75018) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 07 15:46:53 user nova-compute[75018]: INFO nova.compute.manager [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Detaching volume d8788460-9f20-4a53-b870-42b87b947f24
Nov 07 15:46:54 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] [instance: 9d35d8fc-9565-407f-b76b-d7e30df2fc02] Skipping driver_detach during remote rebuild. {{(pid=75018) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 07 15:46:54 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Deleted allocations for instance 9d35d8fc-9565-407f-b76b-d7e30df2fc02
Nov 07 15:46:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7b38f3ac-f4c5-4e60-89e7-c30f0e560236 tempest-TestVolumeBootPattern-1644595019 tempest-TestVolumeBootPattern-1644595019-project-member] Lock "9d35d8fc-9565-407f-b76b-d7e30df2fc02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.653s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:46:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "1013f68f-ef99-4544-a3ce-d5f731b41606" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:46:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:46:56 user nova-compute[75018]: INFO nova.compute.manager [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Unshelving
Nov 07 15:46:57 user nova-compute[75018]: INFO nova.virt.block_device [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Booting with volume 94213c4a-0df9-472e-9256-187bbe0d8c89 at /dev/vda
Nov 07 15:46:57 user nova-compute[75018]: DEBUG os_brick.utils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[755a693a-3591-4b1d-bd83-689135395ef3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[35475121-5ec4-4074-9ddd-7955fa63c803]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e75598-48f7-46c2-af14-c3d04ae1f8e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5133e7a5-d572-4424-88b0-67586a4cc566]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:46:57 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[14290ab4-3204-43d8-b593-be82ccbdd3cf]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG os_brick.utils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updating existing volume attachment record: 1eadff99-2f9e-4bd2-934e-2d3b55ed4579 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-792cf28f-e697-45e0-96e2-96d449685801 req-869b4867-b8c5-4520-b221-86944f417354 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Received event network-changed-46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-792cf28f-e697-45e0-96e2-96d449685801 req-869b4867-b8c5-4520-b221-86944f417354 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Refreshing instance network info cache due to event network-changed-46f42a26-dde5-43b8-a247-c6e8b56a96de. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-792cf28f-e697-45e0-96e2-96d449685801 req-869b4867-b8c5-4520-b221-86944f417354 service nova] Acquiring lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-792cf28f-e697-45e0-96e2-96d449685801 req-869b4867-b8c5-4520-b221-86944f417354 service nova] Acquired lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG nova.network.neutron [req-792cf28f-e697-45e0-96e2-96d449685801 req-869b4867-b8c5-4520-b221-86944f417354 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Refreshing network info cache for port 46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG nova.network.neutron [req-792cf28f-e697-45e0-96e2-96d449685801 req-869b4867-b8c5-4520-b221-86944f417354 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updated VIF entry in instance network info cache for port 46f42a26-dde5-43b8-a247-c6e8b56a96de. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG nova.network.neutron [req-792cf28f-e697-45e0-96e2-96d449685801 req-869b4867-b8c5-4520-b221-86944f417354 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updating instance_info_cache with network_info: [{"id": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "address": "fa:16:3e:9a:04:46", "network": {"id": "a71702a4-b590-4647-8237-28eb0fcd9230", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1031019268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c836eb1cc36a4724995e31466a2a8c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f42a26-dd", "ovs_interfaceid": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:46:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-792cf28f-e697-45e0-96e2-96d449685801 req-869b4867-b8c5-4520-b221-86944f417354 service nova] Releasing lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:47:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lazy-loading 'flavor' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:04 user nova-compute[75018]: INFO nova.compute.manager [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Attaching volume f0281ec8-1520-4d91-80e2-5b64f2ec3bab to /dev/vdb
Nov 07 15:47:04 user nova-compute[75018]: DEBUG os_brick.utils [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[750320b5-4ad2-439a-9dd0-bee924e11fae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f49c484-b744-42c2-8a0e-431f3841436a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[036b49a0-58dd-40aa-a9fe-d93f6dde5fe9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9c7abb-f298-44eb-91a9-009491d68da2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:47:04 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:47:04 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[651e39d5-3688-41a9-8a02-8d407e98ec2e]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG os_brick.utils [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:47:04 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updating existing volume attachment record: 54835e6c-ea80-4648-8a32-956c4a246434 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:47:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:11 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:47:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:47:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:19 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lazy-loading 'pci_requests' on Instance uuid 1013f68f-ef99-4544-a3ce-d5f731b41606 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:47:19 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lazy-loading 'numa_topology' on Instance uuid 1013f68f-ef99-4544-a3ce-d5f731b41606 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:47:19 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:47:19 user nova-compute[75018]: INFO nova.compute.claims [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Claim successful on node user
Nov 07 15:47:20 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:47:20 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:47:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:20 user nova-compute[75018]: INFO nova.network.neutron [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updating port 74fe6639-8825-4ac6-ad52-3c5a6773857f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 07 15:47:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:47:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquired lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:47:20 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:47:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-7c39757b-6406-40ea-b49a-d726ebaf0c12 req-61df821d-c1e8-46dd-8bdb-d5ab009b0199 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-changed-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:47:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-7c39757b-6406-40ea-b49a-d726ebaf0c12 req-61df821d-c1e8-46dd-8bdb-d5ab009b0199 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Refreshing instance network info cache due to event network-changed-74fe6639-8825-4ac6-ad52-3c5a6773857f. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:47:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7c39757b-6406-40ea-b49a-d726ebaf0c12 req-61df821d-c1e8-46dd-8bdb-d5ab009b0199 service nova] Acquiring lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updating instance_info_cache with network_info: [{"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Releasing lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:47:21 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Creating image(s)
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Did not create local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Ensure instance console log exists: /opt/stack/data/nova/instances/1013f68f-ef99-4544-a3ce-d5f731b41606/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Start _get_guest_xml network_info=[{"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgnlWfCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1013f68f-ef99-4544-a3ce-d5f731b41606', 'attached_at': '', 'detached_at': '', 'volume_id': '94213c4a-0df9-472e-9256-187bbe0d8c89', 'serial': '94213c4a-0df9-472e-9256-187bbe0d8c89'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '1eadff99-2f9e-4bd2-934e-2d3b55ed4579', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7c39757b-6406-40ea-b49a-d726ebaf0c12 req-61df821d-c1e8-46dd-8bdb-d5ab009b0199 service nova] Acquired lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.network.neutron [req-7c39757b-6406-40ea-b49a-d726ebaf0c12 req-61df821d-c1e8-46dd-8bdb-d5ab009b0199 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Refreshing network info cache for port 74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:47:21 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:47:21 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.compute.manager [req-d6f6c825-8ee1-4cbf-850b-2277a2111835 req-85202425-7b2c-4af4-a033-1cafa02b01ce service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Received event network-changed-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.compute.manager [req-d6f6c825-8ee1-4cbf-850b-2277a2111835 req-85202425-7b2c-4af4-a033-1cafa02b01ce service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Refreshing instance network info cache due to event network-changed-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d6f6c825-8ee1-4cbf-850b-2277a2111835 req-85202425-7b2c-4af4-a033-1cafa02b01ce service nova] Acquiring lock "refresh_cache-e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d6f6c825-8ee1-4cbf-850b-2277a2111835 req-85202425-7b2c-4af4-a033-1cafa02b01ce service nova] Acquired lock "refresh_cache-e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.network.neutron [req-d6f6c825-8ee1-4cbf-850b-2277a2111835 req-85202425-7b2c-4af4-a033-1cafa02b01ce service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Refreshing network info cache for port 45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1013f68f-ef99-4544-a3ce-d5f731b41606 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.objects.base [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Object Instance<1013f68f-ef99-4544-a3ce-d5f731b41606> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgnlWfCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:47:21 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:47:21 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:47:21 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a95e03-9b58-47f8-a9d4-91fe6d6698ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:47:21 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:21 user nova-compute[75018]: INFO nova.compute.manager [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Terminating instance
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f72b15-60f9-461d-807c-b04635e6055c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89] added
Nov 07 15:47:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[80971f0b-8d48-4600-b21b-c070fc14f692]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[969a6b66-dc31-403b-ada4-60407d683894]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgnlWfCQ {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgnlWfCQ" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fec79c-c56b-4c1d-a354-1296ddf9ef23]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VgnlWfCQ'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a1b7a1-f695-4721-aefa-bc97dd536d30]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdd1ab2-c813-4fdc-94e4-0646d56e00ae]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 15:47:21 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 15:47:21 user nova-compute[75018]:  {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:47:21 user nova-compute[75018]: WARNING os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 15:47:21 user nova-compute[75018]: 
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce488eba-603c-4010-9a93-c9113977d442]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260]
Nov 07 15:47:21 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260] successful.
Nov 07 15:47:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce30548b-9ce9-464d-abfb-ce08556fb3ab]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[85398d87-3716-4987-aa17-3c698f55c9d5]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:47:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:47:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdec99f5-fc07-44d4-b921-f3fe25ec1192]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgnlWfCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.network.neutron [req-7c39757b-6406-40ea-b49a-d726ebaf0c12 req-61df821d-c1e8-46dd-8bdb-d5ab009b0199 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updated VIF entry in instance network info cache for port 74fe6639-8825-4ac6-ad52-3c5a6773857f. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG nova.network.neutron [req-7c39757b-6406-40ea-b49a-d726ebaf0c12 req-61df821d-c1e8-46dd-8bdb-d5ab009b0199 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updating instance_info_cache with network_info: [{"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:47:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7c39757b-6406-40ea-b49a-d726ebaf0c12 req-61df821d-c1e8-46dd-8bdb-d5ab009b0199 service nova] Releasing lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.network.neutron [req-d6f6c825-8ee1-4cbf-850b-2277a2111835 req-85202425-7b2c-4af4-a033-1cafa02b01ce service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Updated VIF entry in instance network info cache for port 45d3ffca-a4ed-4973-8ce0-9a077f3f59fa. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.network.neutron [req-d6f6c825-8ee1-4cbf-850b-2277a2111835 req-85202425-7b2c-4af4-a033-1cafa02b01ce service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Updating instance_info_cache with network_info: [{"id": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "address": "fa:16:3e:19:37:39", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d3ffca-a4", "ovs_interfaceid": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d6f6c825-8ee1-4cbf-850b-2277a2111835 req-85202425-7b2c-4af4-a033-1cafa02b01ce service nova] Releasing lock "refresh_cache-e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:22 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Instance destroyed successfully.
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lazy-loading 'resources' on Instance uuid e542c40d-b3fc-4a79-9777-1d3beaf4a7c3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-93077224',display_name='tempest-TestStampPattern-server-93077224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-93077224',id=39,image_ref='dfc07533-29ec-4cae-9113-9135704d44ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeDr8zIgWa3swsi8kRrbrY4v25ZocRcuaJSVAmNSRGFExsScPphVquqvdpzTXj7/U6FNeAF4YkECYqQe9DkYQFF9FKM0cchxIK1gDnEqMzhDHzyT8Y/sy8bS+7J/epnrg==',key_name='tempest-TestStampPattern-615359145',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:44:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e104a96f426475395c2074a5f84f5c5',ramdisk_id='',reservation_id='r-xdgzctl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7d054231-82b5-43b0-967a-78f5ef690090',image_min_disk='1',image_min_ram='0',image_owner_id='2e104a96f426475395c2074a5f84f5c5',image_owner_project_name='tempest-TestStampPattern-885621001',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-885621001-project-member',image_user_id='57812f43f52442b78301056926451ad2',owner_project_name='tempest-TestStampPattern-885621001',owner_user_name='tempest-TestStampPattern-885621001-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:44:22Z,user_data=None,user_id='57812f43f52442b78301056926451ad2',uuid=e542c40d-b3fc-4a79-9777-1d3beaf4a7c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "address": "fa:16:3e:19:37:39", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d3ffca-a4", "ovs_interfaceid": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Converting VIF {"id": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "address": "fa:16:3e:19:37:39", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d3ffca-a4", "ovs_interfaceid": "45d3ffca-a4ed-4973-8ce0-9a077f3f59fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:37:39,bridge_name='br-int',has_traffic_filtering=True,id=45d3ffca-a4ed-4973-8ce0-9a077f3f59fa,network=Network(6df5c46f-af5e-4d93-a9fa-5224b27e5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45d3ffca-a4') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG os_vif [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:37:39,bridge_name='br-int',has_traffic_filtering=True,id=45d3ffca-a4ed-4973-8ce0-9a077f3f59fa,network=Network(6df5c46f-af5e-4d93-a9fa-5224b27e5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45d3ffca-a4') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45d3ffca-a4, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=933c4f69-70c3-41e2-8db5-dbd1148910ad) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:47:22 user nova-compute[75018]: INFO os_vif [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:37:39,bridge_name='br-int',has_traffic_filtering=True,id=45d3ffca-a4ed-4973-8ce0-9a077f3f59fa,network=Network(6df5c46f-af5e-4d93-a9fa-5224b27e5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45d3ffca-a4')
Nov 07 15:47:22 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Deleting instance files /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3_del
Nov 07 15:47:22 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Deletion of /opt/stack/data/nova/instances/e542c40d-b3fc-4a79-9777-1d3beaf4a7c3_del complete
Nov 07 15:47:22 user nova-compute[75018]: INFO nova.compute.manager [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 07 15:47:22 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23161353530643964', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161353530643964', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T15:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-465451204',display_name='tempest-TestShelveInstance-server-465451204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-465451204',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-486488334',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:43:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e0f296caee0c4c87acaf64774de69cfb',ramdisk_id='',reservation_id='r-p7bfb4yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1838376973',owner_user_name='tempest-TestShelveInstance-1838376973-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:46:57Z,user_data=None,user_id='078ecf188a31491c9841224829899661',uuid=1013f68f-ef99-4544-a3ce-d5f731b41606,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Converting VIF {"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=74fe6639-8825-4ac6-ad52-3c5a6773857f,network=Network(1ec84201-4506-4c97-8ea5-9536271fb4f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fe6639-88') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lazy-loading 'pci_devices' on Instance uuid 1013f68f-ef99-4544-a3ce-d5f731b41606 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.objects.base [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Object Instance<1013f68f-ef99-4544-a3ce-d5f731b41606> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:47:22 user nova-compute[75018]:   <uuid>1013f68f-ef99-4544-a3ce-d5f731b41606</uuid>
Nov 07 15:47:22 user nova-compute[75018]:   <name>instance-00000026</name>
Nov 07 15:47:22 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:47:22 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:47:22 user nova-compute[75018]:   <metadata>
Nov 07 15:47:22 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:47:22 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:47:22 user nova-compute[75018]:       <nova:name>tempest-TestShelveInstance-server-465451204</nova:name>
Nov 07 15:47:22 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:47:21</nova:creationTime>
Nov 07 15:47:22 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:47:22 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:47:22 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:47:22 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:47:22 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:47:22 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:47:22 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:47:22 user nova-compute[75018]:       <nova:owner>
Nov 07 15:47:22 user nova-compute[75018]:         <nova:user uuid="078ecf188a31491c9841224829899661">tempest-TestShelveInstance-1838376973-project-member</nova:user>
Nov 07 15:47:22 user nova-compute[75018]:         <nova:project uuid="e0f296caee0c4c87acaf64774de69cfb">tempest-TestShelveInstance-1838376973</nova:project>
Nov 07 15:47:22 user nova-compute[75018]:       </nova:owner>
Nov 07 15:47:22 user nova-compute[75018]:       <nova:ports>
Nov 07 15:47:22 user nova-compute[75018]:         <nova:port uuid="74fe6639-8825-4ac6-ad52-3c5a6773857f">
Nov 07 15:47:22 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 07 15:47:22 user nova-compute[75018]:         </nova:port>
Nov 07 15:47:22 user nova-compute[75018]:       </nova:ports>
Nov 07 15:47:22 user nova-compute[75018]:     </nova:instance>
Nov 07 15:47:22 user nova-compute[75018]:   </metadata>
Nov 07 15:47:22 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:47:22 user nova-compute[75018]:     <system>
Nov 07 15:47:22 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:47:22 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:47:22 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:47:22 user nova-compute[75018]:       <entry name="serial">1013f68f-ef99-4544-a3ce-d5f731b41606</entry>
Nov 07 15:47:22 user nova-compute[75018]:       <entry name="uuid">1013f68f-ef99-4544-a3ce-d5f731b41606</entry>
Nov 07 15:47:22 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:47:22 user nova-compute[75018]:     </system>
Nov 07 15:47:22 user nova-compute[75018]:   </sysinfo>
Nov 07 15:47:22 user nova-compute[75018]:   <os>
Nov 07 15:47:22 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:47:22 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:47:22 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:47:22 user nova-compute[75018]:   </os>
Nov 07 15:47:22 user nova-compute[75018]:   <features>
Nov 07 15:47:22 user nova-compute[75018]:     <acpi/>
Nov 07 15:47:22 user nova-compute[75018]:     <apic/>
Nov 07 15:47:22 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:47:22 user nova-compute[75018]:   </features>
Nov 07 15:47:22 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:47:22 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:47:22 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:47:22 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:47:22 user nova-compute[75018]:   </clock>
Nov 07 15:47:22 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:47:22 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:47:22 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:47:22 user nova-compute[75018]:   </cpu>
Nov 07 15:47:22 user nova-compute[75018]:   <devices>
Nov 07 15:47:22 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:47:22 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:47:22 user nova-compute[75018]:       <source dev="/dev/sdb"/>
Nov 07 15:47:22 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:47:22 user nova-compute[75018]:       <serial>94213c4a-0df9-472e-9256-187bbe0d8c89</serial>
Nov 07 15:47:22 user nova-compute[75018]:     </disk>
Nov 07 15:47:22 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:47:22 user nova-compute[75018]:       <mac address="fa:16:3e:66:6d:4b"/>
Nov 07 15:47:22 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:47:22 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:47:22 user nova-compute[75018]:       <target dev="tap74fe6639-88"/>
Nov 07 15:47:22 user nova-compute[75018]:     </interface>
Nov 07 15:47:22 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:47:22 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/1013f68f-ef99-4544-a3ce-d5f731b41606/console.log" append="off"/>
Nov 07 15:47:22 user nova-compute[75018]:     </serial>
Nov 07 15:47:22 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:47:22 user nova-compute[75018]:     <video>
Nov 07 15:47:22 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:47:22 user nova-compute[75018]:     </video>
Nov 07 15:47:22 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:47:22 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:47:22 user nova-compute[75018]:     </rng>
Nov 07 15:47:22 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:47:22 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:47:22 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:47:22 user nova-compute[75018]:     </memballoon>
Nov 07 15:47:22 user nova-compute[75018]:   </devices>
Nov 07 15:47:22 user nova-compute[75018]: </domain>
Nov 07 15:47:22 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T15:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-465451204',display_name='tempest-TestShelveInstance-server-465451204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-465451204',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-486488334',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:43:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e0f296caee0c4c87acaf64774de69cfb',ramdisk_id='',reservation_id='r-p7bfb4yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1838376973',owner_user_name='tempest-TestShelveInstance-1838376973-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:46:57Z,user_data=None,user_id='078ecf188a31491c9841224829899661',uuid=1013f68f-ef99-4544-a3ce-d5f731b41606,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Converting VIF {"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=74fe6639-8825-4ac6-ad52-3c5a6773857f,network=Network(1ec84201-4506-4c97-8ea5-9536271fb4f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fe6639-88') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG os_vif [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=74fe6639-8825-4ac6-ad52-3c5a6773857f,network=Network(1ec84201-4506-4c97-8ea5-9536271fb4f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fe6639-88') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e008820e-c500-5ca7-9b19-703e7c7e339b', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74fe6639-88, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74fe6639-88, col_values=(('qos', UUID('f95dcf64-e675-4378-845a-92fae7a4568b')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74fe6639-88, col_values=(('external_ids', {'iface-id': '74fe6639-8825-4ac6-ad52-3c5a6773857f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:6d:4b', 'vm-uuid': '1013f68f-ef99-4544-a3ce-d5f731b41606'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:22 user nova-compute[75018]: INFO os_vif [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=74fe6639-8825-4ac6-ad52-3c5a6773857f,network=Network(1ec84201-4506-4c97-8ea5-9536271fb4f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fe6639-88')
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] No VIF found with MAC fa:16:3e:66:6d:4b, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:47:22 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:47:22 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Took 0.43 seconds to deallocate network for instance.
Nov 07 15:47:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:23 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:47:23 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:47:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:23 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Deleted allocations for instance e542c40d-b3fc-4a79-9777-1d3beaf4a7c3
Nov 07 15:47:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a6dd8d10-3252-456a-967e-dc0f613b07ef tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.892s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:23 user nova-compute[75018]: DEBUG nova.compute.manager [req-cb19d73f-259e-43c4-b9af-1771e9f92006 req-0bfc0bb8-5124-4674-a67a-86bf50a1070b service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Received event network-vif-unplugged-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:47:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cb19d73f-259e-43c4-b9af-1771e9f92006 req-0bfc0bb8-5124-4674-a67a-86bf50a1070b service nova] Acquiring lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cb19d73f-259e-43c4-b9af-1771e9f92006 req-0bfc0bb8-5124-4674-a67a-86bf50a1070b service nova] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cb19d73f-259e-43c4-b9af-1771e9f92006 req-0bfc0bb8-5124-4674-a67a-86bf50a1070b service nova] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:23 user nova-compute[75018]: DEBUG nova.compute.manager [req-cb19d73f-259e-43c4-b9af-1771e9f92006 req-0bfc0bb8-5124-4674-a67a-86bf50a1070b service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] No waiting events found dispatching network-vif-unplugged-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:47:23 user nova-compute[75018]: WARNING nova.compute.manager [req-cb19d73f-259e-43c4-b9af-1771e9f92006 req-0bfc0bb8-5124-4674-a67a-86bf50a1070b service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Received unexpected event network-vif-unplugged-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa for instance with vm_state deleted and task_state None.
Nov 07 15:47:23 user nova-compute[75018]: DEBUG nova.compute.manager [req-cb19d73f-259e-43c4-b9af-1771e9f92006 req-0bfc0bb8-5124-4674-a67a-86bf50a1070b service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Received event network-vif-plugged-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:47:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cb19d73f-259e-43c4-b9af-1771e9f92006 req-0bfc0bb8-5124-4674-a67a-86bf50a1070b service nova] Acquiring lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cb19d73f-259e-43c4-b9af-1771e9f92006 req-0bfc0bb8-5124-4674-a67a-86bf50a1070b service nova] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cb19d73f-259e-43c4-b9af-1771e9f92006 req-0bfc0bb8-5124-4674-a67a-86bf50a1070b service nova] Lock "e542c40d-b3fc-4a79-9777-1d3beaf4a7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:23 user nova-compute[75018]: DEBUG nova.compute.manager [req-cb19d73f-259e-43c4-b9af-1771e9f92006 req-0bfc0bb8-5124-4674-a67a-86bf50a1070b service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] No waiting events found dispatching network-vif-plugged-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:47:23 user nova-compute[75018]: WARNING nova.compute.manager [req-cb19d73f-259e-43c4-b9af-1771e9f92006 req-0bfc0bb8-5124-4674-a67a-86bf50a1070b service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Received unexpected event network-vif-plugged-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa for instance with vm_state deleted and task_state None.
Nov 07 15:47:23 user nova-compute[75018]: DEBUG nova.compute.manager [req-cb19d73f-259e-43c4-b9af-1771e9f92006 req-0bfc0bb8-5124-4674-a67a-86bf50a1070b service nova] [instance: e542c40d-b3fc-4a79-9777-1d3beaf4a7c3] Received event network-vif-deleted-45d3ffca-a4ed-4973-8ce0-9a077f3f59fa {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:47:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-5d07e272-5ed5-449c-bec9-d0b3ee195345 req-40c004fb-e326-4544-901f-17a3bf2542ae service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:47:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5d07e272-5ed5-449c-bec9-d0b3ee195345 req-40c004fb-e326-4544-901f-17a3bf2542ae service nova] Acquiring lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5d07e272-5ed5-449c-bec9-d0b3ee195345 req-40c004fb-e326-4544-901f-17a3bf2542ae service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5d07e272-5ed5-449c-bec9-d0b3ee195345 req-40c004fb-e326-4544-901f-17a3bf2542ae service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-5d07e272-5ed5-449c-bec9-d0b3ee195345 req-40c004fb-e326-4544-901f-17a3bf2542ae service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] No waiting events found dispatching network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:47:25 user nova-compute[75018]: WARNING nova.compute.manager [req-5d07e272-5ed5-449c-bec9-d0b3ee195345 req-40c004fb-e326-4544-901f-17a3bf2542ae service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received unexpected event network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 07 15:47:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-5d07e272-5ed5-449c-bec9-d0b3ee195345 req-40c004fb-e326-4544-901f-17a3bf2542ae service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:47:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5d07e272-5ed5-449c-bec9-d0b3ee195345 req-40c004fb-e326-4544-901f-17a3bf2542ae service nova] Acquiring lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5d07e272-5ed5-449c-bec9-d0b3ee195345 req-40c004fb-e326-4544-901f-17a3bf2542ae service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5d07e272-5ed5-449c-bec9-d0b3ee195345 req-40c004fb-e326-4544-901f-17a3bf2542ae service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-5d07e272-5ed5-449c-bec9-d0b3ee195345 req-40c004fb-e326-4544-901f-17a3bf2542ae service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] No waiting events found dispatching network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:47:25 user nova-compute[75018]: WARNING nova.compute.manager [req-5d07e272-5ed5-449c-bec9-d0b3ee195345 req-40c004fb-e326-4544-901f-17a3bf2542ae service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received unexpected event network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 07 15:47:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:47:26 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:47:26 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Instance spawned successfully.
Nov 07 15:47:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:47:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c4165b53-d15c-4c71-860e-257b1c435ce6 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 29.732s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qmDfwQBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:47:27 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:47:27 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:47:27 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[317f97ae-2932-4c89-abbb-07bd1771d50c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:47:27 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7bddf3-5720-45b7-bb2e-24f5adbfb73a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab] added
Nov 07 15:47:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2773e547-48b2-48c7-8650-bdd488e3d73c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e275cfdd-6adc-4ec1-a112-2d802d86e737]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qmDfwQBz {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qmDfwQBz" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c248e3-d8e0-4032-927a-9ba938615738]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qmDfwQBz'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[39653234-d5e1-448f-800d-d94677683b90]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e20fd4d-895c-4cc7-811e-231cfbc0fcd1]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:47:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:47:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da4b694-cea3-453a-b991-a9a836b3bda3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab, portal: 172.16.0.220,3260]
Nov 07 15:47:27 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab, portal: 172.16.0.220,3260] successful.
Nov 07 15:47:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[10994191-e093-4b97-a014-45fff2d8756e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2410f1bd-278c-40c0-aa32-a7bcb53adebb]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:47:27 user nova-compute[75018]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab (non-flash)
Nov 07 15:47:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:47:27 user nova-compute[75018]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab (non-flash)
Nov 07 15:47:27 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd126bc6-1752-4e05-adb1-3d13155f2b0d]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qmDfwQBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:47:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:47:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26534356338373339', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:47:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534356338373339', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:47:28 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lazy-loading 'flavor' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:47:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:47:28 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:47:28 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:47:28 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:47:28 user nova-compute[75018]:   <serial>f0281ec8-1520-4d91-80e2-5b64f2ec3bab</serial>
Nov 07 15:47:28 user nova-compute[75018]: </disk>
Nov 07 15:47:28 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:47:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:47:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:47:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] No VIF found with MAC fa:16:3e:9a:04:46, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:47:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3092b06e-cd3d-47c7-939a-2de599838231 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.232s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:33 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:47:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:47:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:38 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:47:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "8e787e6f-2844-4407-ba44-a60b5830cdab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:47:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:47:41 user nova-compute[75018]: INFO nova.compute.claims [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Claim successful on node user
Nov 07 15:47:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:47:41 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:47:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG nova.policy [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b85e59486dda47eeb7b0cf5ddf732ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b703f914a00c4d5399fbd2a05d855e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:47:41 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Creating image(s)
Nov 07 15:47:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "/opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "/opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:41 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.213s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk 1073741824" returned: 0 in 0.071s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Successfully created port: 3192852d-5bc2-4ea2-bf7c-95a5163f0d40 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updating instance_info_cache with network_info: [{"id": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "address": "fa:16:3e:9a:04:46", "network": {"id": "a71702a4-b590-4647-8237-28eb0fcd9230", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1031019268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c836eb1cc36a4724995e31466a2a8c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f42a26-dd", "ovs_interfaceid": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.223s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Cannot resize image /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Ensure instance console log exists: /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Successfully updated port: 3192852d-5bc2-4ea2-bf7c-95a5163f0d40 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquired lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:47:42 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-b17cd352-75bc-46dd-9f5b-0e5bfbe7bf00 req-174b30d7-5808-4970-8675-8cd36e1f9862 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Received event network-changed-3192852d-5bc2-4ea2-bf7c-95a5163f0d40 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-b17cd352-75bc-46dd-9f5b-0e5bfbe7bf00 req-174b30d7-5808-4970-8675-8cd36e1f9862 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Refreshing instance network info cache due to event network-changed-3192852d-5bc2-4ea2-bf7c-95a5163f0d40. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b17cd352-75bc-46dd-9f5b-0e5bfbe7bf00 req-174b30d7-5808-4970-8675-8cd36e1f9862 service nova] Acquiring lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updating instance_info_cache with network_info: [{"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Releasing lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Instance network_info: |[{"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b17cd352-75bc-46dd-9f5b-0e5bfbe7bf00 req-174b30d7-5808-4970-8675-8cd36e1f9862 service nova] Acquired lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.network.neutron [req-b17cd352-75bc-46dd-9f5b-0e5bfbe7bf00 req-174b30d7-5808-4970-8675-8cd36e1f9862 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Refreshing network info cache for port 3192852d-5bc2-4ea2-bf7c-95a5163f0d40 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Start _get_guest_xml network_info=[{"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:47:43 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:47:43 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-367494956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-367494956',id=43,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b703f914a00c4d5399fbd2a05d855e20',ramdisk_id='',reservation_id='r-24hzlf7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:47:42Z,user_data=None,user_id='b85e59486dda47eeb7b0cf5ddf732ecf',uuid=8e787e6f-2844-4407-ba44-a60b5830cdab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converting VIF {"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ba:31,bridge_name='br-int',has_traffic_filtering=True,id=3192852d-5bc2-4ea2-bf7c-95a5163f0d40,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3192852d-5b') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.objects.instance [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e787e6f-2844-4407-ba44-a60b5830cdab {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:47:43 user nova-compute[75018]:   <uuid>8e787e6f-2844-4407-ba44-a60b5830cdab</uuid>
Nov 07 15:47:43 user nova-compute[75018]:   <name>instance-0000002b</name>
Nov 07 15:47:43 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:47:43 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:47:43 user nova-compute[75018]:   <metadata>
Nov 07 15:47:43 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:47:43 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:47:43 user nova-compute[75018]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-367494956</nova:name>
Nov 07 15:47:43 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:47:43</nova:creationTime>
Nov 07 15:47:43 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:47:43 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:47:43 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:47:43 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:47:43 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:47:43 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:47:43 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:47:43 user nova-compute[75018]:       <nova:owner>
Nov 07 15:47:43 user nova-compute[75018]:         <nova:user uuid="b85e59486dda47eeb7b0cf5ddf732ecf">tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member</nova:user>
Nov 07 15:47:43 user nova-compute[75018]:         <nova:project uuid="b703f914a00c4d5399fbd2a05d855e20">tempest-ServerBootFromVolumeStableRescueTest-1314994176</nova:project>
Nov 07 15:47:43 user nova-compute[75018]:       </nova:owner>
Nov 07 15:47:43 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:47:43 user nova-compute[75018]:       <nova:ports>
Nov 07 15:47:43 user nova-compute[75018]:         <nova:port uuid="3192852d-5bc2-4ea2-bf7c-95a5163f0d40">
Nov 07 15:47:43 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 07 15:47:43 user nova-compute[75018]:         </nova:port>
Nov 07 15:47:43 user nova-compute[75018]:       </nova:ports>
Nov 07 15:47:43 user nova-compute[75018]:     </nova:instance>
Nov 07 15:47:43 user nova-compute[75018]:   </metadata>
Nov 07 15:47:43 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:47:43 user nova-compute[75018]:     <system>
Nov 07 15:47:43 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:47:43 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:47:43 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:47:43 user nova-compute[75018]:       <entry name="serial">8e787e6f-2844-4407-ba44-a60b5830cdab</entry>
Nov 07 15:47:43 user nova-compute[75018]:       <entry name="uuid">8e787e6f-2844-4407-ba44-a60b5830cdab</entry>
Nov 07 15:47:43 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:47:43 user nova-compute[75018]:     </system>
Nov 07 15:47:43 user nova-compute[75018]:   </sysinfo>
Nov 07 15:47:43 user nova-compute[75018]:   <os>
Nov 07 15:47:43 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:47:43 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:47:43 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:47:43 user nova-compute[75018]:   </os>
Nov 07 15:47:43 user nova-compute[75018]:   <features>
Nov 07 15:47:43 user nova-compute[75018]:     <acpi/>
Nov 07 15:47:43 user nova-compute[75018]:     <apic/>
Nov 07 15:47:43 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:47:43 user nova-compute[75018]:   </features>
Nov 07 15:47:43 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:47:43 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:47:43 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:47:43 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:47:43 user nova-compute[75018]:   </clock>
Nov 07 15:47:43 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:47:43 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:47:43 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:47:43 user nova-compute[75018]:   </cpu>
Nov 07 15:47:43 user nova-compute[75018]:   <devices>
Nov 07 15:47:43 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:47:43 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:47:43 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk"/>
Nov 07 15:47:43 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:47:43 user nova-compute[75018]:     </disk>
Nov 07 15:47:43 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:47:43 user nova-compute[75018]:       <mac address="fa:16:3e:df:ba:31"/>
Nov 07 15:47:43 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:47:43 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:47:43 user nova-compute[75018]:       <target dev="tap3192852d-5b"/>
Nov 07 15:47:43 user nova-compute[75018]:     </interface>
Nov 07 15:47:43 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:47:43 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/console.log" append="off"/>
Nov 07 15:47:43 user nova-compute[75018]:     </serial>
Nov 07 15:47:43 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:47:43 user nova-compute[75018]:     <video>
Nov 07 15:47:43 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:47:43 user nova-compute[75018]:     </video>
Nov 07 15:47:43 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:47:43 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:47:43 user nova-compute[75018]:     </rng>
Nov 07 15:47:43 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:47:43 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:47:43 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:47:43 user nova-compute[75018]:     </memballoon>
Nov 07 15:47:43 user nova-compute[75018]:   </devices>
Nov 07 15:47:43 user nova-compute[75018]: </domain>
Nov 07 15:47:43 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-367494956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-367494956',id=43,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b703f914a00c4d5399fbd2a05d855e20',ramdisk_id='',reservation_id='r-24hzlf7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:47:42Z,user_data=None,user_id='b85e59486dda47eeb7b0cf5ddf732ecf',uuid=8e787e6f-2844-4407-ba44-a60b5830cdab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converting VIF {"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ba:31,bridge_name='br-int',has_traffic_filtering=True,id=3192852d-5bc2-4ea2-bf7c-95a5163f0d40,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3192852d-5b') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG os_vif [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ba:31,bridge_name='br-int',has_traffic_filtering=True,id=3192852d-5bc2-4ea2-bf7c-95a5163f0d40,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3192852d-5b') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c25378a3-cf5c-5feb-8f89-05baf06c5d78', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3192852d-5b, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3192852d-5b, col_values=(('qos', UUID('afb9df6c-bcd7-4d14-8486-53ea065d3396')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3192852d-5b, col_values=(('external_ids', {'iface-id': '3192852d-5bc2-4ea2-bf7c-95a5163f0d40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:ba:31', 'vm-uuid': '8e787e6f-2844-4407-ba44-a60b5830cdab'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:43 user nova-compute[75018]: INFO os_vif [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ba:31,bridge_name='br-int',has_traffic_filtering=True,id=3192852d-5bc2-4ea2-bf7c-95a5163f0d40,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3192852d-5b')
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] No VIF found with MAC fa:16:3e:df:ba:31, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.network.neutron [req-b17cd352-75bc-46dd-9f5b-0e5bfbe7bf00 req-174b30d7-5808-4970-8675-8cd36e1f9862 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updated VIF entry in instance network info cache for port 3192852d-5bc2-4ea2-bf7c-95a5163f0d40. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG nova.network.neutron [req-b17cd352-75bc-46dd-9f5b-0e5bfbe7bf00 req-174b30d7-5808-4970-8675-8cd36e1f9862 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updating instance_info_cache with network_info: [{"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:47:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b17cd352-75bc-46dd-9f5b-0e5bfbe7bf00 req-174b30d7-5808-4970-8675-8cd36e1f9862 service nova] Releasing lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:47:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:47:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-4153b546-0470-4138-968a-e956348fcff3 req-94db0e0c-ddb4-45a2-bcf9-8a527f451bb6 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Received event network-vif-plugged-3192852d-5bc2-4ea2-bf7c-95a5163f0d40 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:47:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4153b546-0470-4138-968a-e956348fcff3 req-94db0e0c-ddb4-45a2-bcf9-8a527f451bb6 service nova] Acquiring lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4153b546-0470-4138-968a-e956348fcff3 req-94db0e0c-ddb4-45a2-bcf9-8a527f451bb6 service nova] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4153b546-0470-4138-968a-e956348fcff3 req-94db0e0c-ddb4-45a2-bcf9-8a527f451bb6 service nova] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-4153b546-0470-4138-968a-e956348fcff3 req-94db0e0c-ddb4-45a2-bcf9-8a527f451bb6 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] No waiting events found dispatching network-vif-plugged-3192852d-5bc2-4ea2-bf7c-95a5163f0d40 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:47:45 user nova-compute[75018]: WARNING nova.compute.manager [req-4153b546-0470-4138-968a-e956348fcff3 req-94db0e0c-ddb4-45a2-bcf9-8a527f451bb6 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Received unexpected event network-vif-plugged-3192852d-5bc2-4ea2-bf7c-95a5163f0d40 for instance with vm_state building and task_state spawning.
Nov 07 15:47:45 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:47:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-57875fdd-cff7-47b1-b348-a86e6ba36f41 req-27de9c3e-b7e3-4087-984e-1fdf4903dea5 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Received event network-vif-plugged-3192852d-5bc2-4ea2-bf7c-95a5163f0d40 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:47:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-57875fdd-cff7-47b1-b348-a86e6ba36f41 req-27de9c3e-b7e3-4087-984e-1fdf4903dea5 service nova] Acquiring lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-57875fdd-cff7-47b1-b348-a86e6ba36f41 req-27de9c3e-b7e3-4087-984e-1fdf4903dea5 service nova] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-57875fdd-cff7-47b1-b348-a86e6ba36f41 req-27de9c3e-b7e3-4087-984e-1fdf4903dea5 service nova] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-57875fdd-cff7-47b1-b348-a86e6ba36f41 req-27de9c3e-b7e3-4087-984e-1fdf4903dea5 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] No waiting events found dispatching network-vif-plugged-3192852d-5bc2-4ea2-bf7c-95a5163f0d40 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:47:47 user nova-compute[75018]: WARNING nova.compute.manager [req-57875fdd-cff7-47b1-b348-a86e6ba36f41 req-27de9c3e-b7e3-4087-984e-1fdf4903dea5 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Received unexpected event network-vif-plugged-3192852d-5bc2-4ea2-bf7c-95a5163f0d40 for instance with vm_state building and task_state spawning.
Nov 07 15:47:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:47:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:47:47 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Instance spawned successfully.
Nov 07 15:47:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:47:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:47:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:47:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:47:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:47:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:47:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:47:47 user nova-compute[75018]: INFO nova.compute.manager [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 07 15:47:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:47:47 user nova-compute[75018]: INFO nova.compute.manager [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Took 6.72 seconds to build instance.
Nov 07 15:47:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-5d4bdddc-0e53-4f92-a389-24ad165fe47f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.821s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:49 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:47:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:49 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:47:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:50 user nova-compute[75018]: DEBUG nova.objects.instance [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'flavor' on Instance uuid 2ffc6cf3-fb96-48b1-9783-6434e107f09e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:47:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090/disk --force-share --output=json" returned: 0 in 0.632s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.005s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:50 user nova-compute[75018]: INFO nova.compute.manager [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Attaching volume c2d0cd3b-6433-4b9b-b293-503fe2f4d43d to /dev/vdb
Nov 07 15:47:50 user nova-compute[75018]: DEBUG os_brick.utils [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:47:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d42f22-0ee1-4578-942d-b45b9ea28eea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[82da8fc4-8b98-4543-8095-d184c36bdf68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dcdc09-8024-40f5-bed2-89e93d0429a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ab6286-e7d9-4458-9781-568b47184da4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:47:51 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcc2a8d-1b5d-49ca-93c7-ae7414a2aac0]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG os_brick.utils [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] <== get_connector_properties: return (228ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updating existing volume attachment record: 3437c508-bc0d-4910-aaa3-a1db0abd0325 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:47:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:47:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:47:52 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:47:52 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:47:52 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8186MB free_disk=24.877239227294922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:47:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 7d054231-82b5-43b0-967a-78f5ef690090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:47:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 64559109-6166-488d-a457-20b5f01ddf40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:47:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 2ffc6cf3-fb96-48b1-9783-6434e107f09e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:47:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 1013f68f-ef99-4544-a3ce-d5f731b41606 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:47:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:47:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:47:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:47:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:53 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:47:53 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:47:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:47:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 7d054231-82b5-43b0-967a-78f5ef690090 {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 1013f68f-ef99-4544-a3ce-d5f731b41606 {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 2ffc6cf3-fb96-48b1-9783-6434e107f09e {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 8e787e6f-2844-4407-ba44-a60b5830cdab {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "7d054231-82b5-43b0-967a-78f5ef690090" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "7d054231-82b5-43b0-967a-78f5ef690090" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "1013f68f-ef99-4544-a3ce-d5f731b41606" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "8e787e6f-2844-4407-ba44-a60b5830cdab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "7d054231-82b5-43b0-967a-78f5ef690090" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:47:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:11 user nova-compute[75018]: INFO nova.compute.manager [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Detaching volume f0281ec8-1520-4d91-80e2-5b64f2ec3bab
Nov 07 15:48:12 user nova-compute[75018]: INFO nova.virt.block_device [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Attempting to driver detach volume f0281ec8-1520-4d91-80e2-5b64f2ec3bab from mountpoint /dev/vdb
Nov 07 15:48:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Attempting to detach device vdb from instance 64559109-6166-488d-a457-20b5f01ddf40 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:48:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:48:12 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:48:12 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:48:12 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:48:12 user nova-compute[75018]:   <serial>f0281ec8-1520-4d91-80e2-5b64f2ec3bab</serial>
Nov 07 15:48:12 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:48:12 user nova-compute[75018]: </disk>
Nov 07 15:48:12 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:48:12 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Successfully detached device vdb from instance 64559109-6166-488d-a457-20b5f01ddf40 from the persistent domain config.
Nov 07 15:48:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64559109-6166-488d-a457-20b5f01ddf40 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:48:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:48:12 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:48:12 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:48:12 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:48:12 user nova-compute[75018]:   <serial>f0281ec8-1520-4d91-80e2-5b64f2ec3bab</serial>
Nov 07 15:48:12 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:48:12 user nova-compute[75018]: </disk>
Nov 07 15:48:12 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:48:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:48:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhIgDUCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:48:14 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:48:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:48:14 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:48:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:48:14 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:48:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2359b2a2-e9ee-44e4-b87d-b92f38e0cc93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:48:14 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[823da9f8-07d6-4f16-9518-2f8b82928386]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d] added
Nov 07 15:48:14 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eec0d96-c672-44e7-bb6f-a5f63834e858]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c76875-d13e-4151-9527-3c22f91644c9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vhIgDUCT {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vhIgDUCT" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7e8c16-483a-427d-a8c8-7cf99f923476]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vhIgDUCT'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e978d6-1067-4ce2-8920-9f87218e2650]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb7671e-df41-47ad-9e64-b9429ccf182b]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:48:15 user nova-compute[75018]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab (non-flash)
Nov 07 15:48:15 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:48:15 user nova-compute[75018]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab (non-flash)
Nov 07 15:48:15 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aa4513-f5f4-48f2-afef-066dea59d400]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260]
Nov 07 15:48:15 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260] successful.
Nov 07 15:48:15 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6424b0c-518b-4107-844d-14a7974d8a26]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a2466a-9ae2-4944-a05a-6cab5d6fbd61]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:48:15 user nova-compute[75018]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab (non-flash)
Nov 07 15:48:15 user nova-compute[75018]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:48:15 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:48:15 user nova-compute[75018]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab (non-flash)
Nov 07 15:48:15 user nova-compute[75018]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:48:15 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba508298-01f4-4861-889c-b0c50a67c774]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:15 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:48:16 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:48:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhIgDUCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:48:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:48:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23961613335623764', 'path': '/dev/sdd'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:48:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961613335623764', 'path': '/dev/sdd'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:48:16 user nova-compute[75018]: DEBUG nova.objects.instance [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'flavor' on Instance uuid 2ffc6cf3-fb96-48b1-9783-6434e107f09e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:48:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:48:16 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:48:16 user nova-compute[75018]:   <source dev="/dev/sdd"/>
Nov 07 15:48:16 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:48:16 user nova-compute[75018]:   <serial>c2d0cd3b-6433-4b9b-b293-503fe2f4d43d</serial>
Nov 07 15:48:16 user nova-compute[75018]: </disk>
Nov 07 15:48:16 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:48:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:48:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:48:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] No VIF found with MAC fa:16:3e:e3:3f:4c, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:48:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-545b4503-3722-4044-8996-01920c808eee tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.956s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 20.309s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-dd704f1a-f34b-4f90-891a-378a8b96918f req-46bad785-45e1-4790-b459-66e61e2d6d16 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-changed-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-dd704f1a-f34b-4f90-891a-378a8b96918f req-46bad785-45e1-4790-b459-66e61e2d6d16 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Refreshing instance network info cache due to event network-changed-fba78b12-1ec4-4b48-b972-fabe6eb861cb. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-dd704f1a-f34b-4f90-891a-378a8b96918f req-46bad785-45e1-4790-b459-66e61e2d6d16 service nova] Acquiring lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-dd704f1a-f34b-4f90-891a-378a8b96918f req-46bad785-45e1-4790-b459-66e61e2d6d16 service nova] Acquired lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-dd704f1a-f34b-4f90-891a-378a8b96918f req-46bad785-45e1-4790-b459-66e61e2d6d16 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Refreshing network info cache for port fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:48:32 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 64559109-6166-488d-a457-20b5f01ddf40 is timed out.
Nov 07 15:48:32 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Successfully detached device vdb from instance 64559109-6166-488d-a457-20b5f01ddf40 from the live domain config.
Nov 07 15:48:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qmDfwQBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:48:32 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[652af3d8-0e07-4b87-abc3-101b8351a56b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:48:32 user nova-compute[75018]: No targets found.
Nov 07 15:48:32 user nova-compute[75018]: iSNS:
Nov 07 15:48:32 user nova-compute[75018]: No targets found.
Nov 07 15:48:32 user nova-compute[75018]: STATIC:
Nov 07 15:48:32 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab
Nov 07 15:48:32 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:48:32 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:48:32 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89
Nov 07 15:48:32 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:48:32 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:48:32 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d
Nov 07 15:48:32 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:48:32 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:48:32 user nova-compute[75018]: FIRMWARE:
Nov 07 15:48:32 user nova-compute[75018]: No targets found.
Nov 07 15:48:32 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:48:32 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:48:32 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[44075d49-bd23-4f50-ad32-d3b889e44757]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41e4b1d-fc63-4e39-affc-d824b6c47857]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:48:32 user nova-compute[75018]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab (non-flash)
Nov 07 15:48:32 user nova-compute[75018]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:48:32 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:48:32 user nova-compute[75018]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab (non-flash)
Nov 07 15:48:32 user nova-compute[75018]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:48:32 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae03339a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab'): ({'sdc'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Removing single pathed devices sdc {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8334dd4e-6d0e-422b-a4e2-7a0d42609a64]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[affb1152-4d57-4f0c-b05c-de5a8072084a]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Flushing IO for device /dev/sdc {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ce547e-370e-4434-88ef-290ba75f3559]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[435a2d14-d97b-461a-8301-bb9af02b3947]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ae1196-ae05-46c6-8f60-c86ad764c08d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0a38b8-892f-48bb-90c6-fcb08b0c962c]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab, portal: 172.16.0.220,3260]
Nov 07 15:48:32 user nova-compute[75018]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab, portal: 172.16.0.220,3260] successful.
Nov 07 15:48:32 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0281ec8-1520-4d91-80e2-5b64f2ec3bab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41b9977-c4cb-44d8-8719-680489c0cc95]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] <== disconnect_volume: return (309ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-dd704f1a-f34b-4f90-891a-378a8b96918f req-46bad785-45e1-4790-b459-66e61e2d6d16 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updated VIF entry in instance network info cache for port fba78b12-1ec4-4b48-b972-fabe6eb861cb. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-dd704f1a-f34b-4f90-891a-378a8b96918f req-46bad785-45e1-4790-b459-66e61e2d6d16 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updating instance_info_cache with network_info: [{"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:48:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-dd704f1a-f34b-4f90-891a-378a8b96918f req-46bad785-45e1-4790-b459-66e61e2d6d16 service nova] Releasing lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:48:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:48:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:48:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:48:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:48:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:33 user nova-compute[75018]: DEBUG nova.objects.instance [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lazy-loading 'flavor' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:48:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-543be8da-77f3-4ded-a506-67860e890b1d tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.933s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-de71ca2b-936b-4d89-b08e-9e232989f4d7 req-2e4d757c-de5c-4231-866d-e20cc534a18f service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-changed-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-de71ca2b-936b-4d89-b08e-9e232989f4d7 req-2e4d757c-de5c-4231-866d-e20cc534a18f service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Refreshing instance network info cache due to event network-changed-fba78b12-1ec4-4b48-b972-fabe6eb861cb. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:48:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-de71ca2b-936b-4d89-b08e-9e232989f4d7 req-2e4d757c-de5c-4231-866d-e20cc534a18f service nova] Acquiring lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:48:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-de71ca2b-936b-4d89-b08e-9e232989f4d7 req-2e4d757c-de5c-4231-866d-e20cc534a18f service nova] Acquired lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:48:34 user nova-compute[75018]: DEBUG nova.network.neutron [req-de71ca2b-936b-4d89-b08e-9e232989f4d7 req-2e4d757c-de5c-4231-866d-e20cc534a18f service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Refreshing network info cache for port fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:48:34 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:48:35 user nova-compute[75018]: DEBUG nova.network.neutron [req-de71ca2b-936b-4d89-b08e-9e232989f4d7 req-2e4d757c-de5c-4231-866d-e20cc534a18f service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updated VIF entry in instance network info cache for port fba78b12-1ec4-4b48-b972-fabe6eb861cb. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:48:35 user nova-compute[75018]: DEBUG nova.network.neutron [req-de71ca2b-936b-4d89-b08e-9e232989f4d7 req-2e4d757c-de5c-4231-866d-e20cc534a18f service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updating instance_info_cache with network_info: [{"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:48:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-de71ca2b-936b-4d89-b08e-9e232989f4d7 req-2e4d757c-de5c-4231-866d-e20cc534a18f service nova] Releasing lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-ff614405-1f2d-4a95-a993-52344c214efb req-d0f5b7d4-7c26-47ce-952d-11a5634cc7f9 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Received event network-changed-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-ff614405-1f2d-4a95-a993-52344c214efb req-d0f5b7d4-7c26-47ce-952d-11a5634cc7f9 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Refreshing instance network info cache due to event network-changed-d2a12c3d-09d4-4648-8ad3-11e5e77e2837. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ff614405-1f2d-4a95-a993-52344c214efb req-d0f5b7d4-7c26-47ce-952d-11a5634cc7f9 service nova] Acquiring lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ff614405-1f2d-4a95-a993-52344c214efb req-d0f5b7d4-7c26-47ce-952d-11a5634cc7f9 service nova] Acquired lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG nova.network.neutron [req-ff614405-1f2d-4a95-a993-52344c214efb req-d0f5b7d4-7c26-47ce-952d-11a5634cc7f9 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Refreshing network info cache for port d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "7d054231-82b5-43b0-967a-78f5ef690090" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "7d054231-82b5-43b0-967a-78f5ef690090" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "7d054231-82b5-43b0-967a-78f5ef690090-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "7d054231-82b5-43b0-967a-78f5ef690090-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "7d054231-82b5-43b0-967a-78f5ef690090-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:36 user nova-compute[75018]: INFO nova.compute.manager [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Terminating instance
Nov 07 15:48:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG nova.network.neutron [req-ff614405-1f2d-4a95-a993-52344c214efb req-d0f5b7d4-7c26-47ce-952d-11a5634cc7f9 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Updated VIF entry in instance network info cache for port d2a12c3d-09d4-4648-8ad3-11e5e77e2837. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG nova.network.neutron [req-ff614405-1f2d-4a95-a993-52344c214efb req-d0f5b7d4-7c26-47ce-952d-11a5634cc7f9 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Updating instance_info_cache with network_info: [{"id": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "address": "fa:16:3e:15:0a:74", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a12c3d-09", "ovs_interfaceid": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-f33fb668-ed2b-4093-b0bc-6541adaa127e req-f205fadd-4cd1-40f8-a3cd-7e574c855b5a service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Received event network-vif-unplugged-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f33fb668-ed2b-4093-b0bc-6541adaa127e req-f205fadd-4cd1-40f8-a3cd-7e574c855b5a service nova] Acquiring lock "7d054231-82b5-43b0-967a-78f5ef690090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f33fb668-ed2b-4093-b0bc-6541adaa127e req-f205fadd-4cd1-40f8-a3cd-7e574c855b5a service nova] Lock "7d054231-82b5-43b0-967a-78f5ef690090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-f33fb668-ed2b-4093-b0bc-6541adaa127e req-f205fadd-4cd1-40f8-a3cd-7e574c855b5a service nova] Lock "7d054231-82b5-43b0-967a-78f5ef690090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-f33fb668-ed2b-4093-b0bc-6541adaa127e req-f205fadd-4cd1-40f8-a3cd-7e574c855b5a service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] No waiting events found dispatching network-vif-unplugged-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-f33fb668-ed2b-4093-b0bc-6541adaa127e req-f205fadd-4cd1-40f8-a3cd-7e574c855b5a service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Received event network-vif-unplugged-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:48:36 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Instance destroyed successfully.
Nov 07 15:48:36 user nova-compute[75018]: DEBUG nova.objects.instance [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lazy-loading 'resources' on Instance uuid 7d054231-82b5-43b0-967a-78f5ef690090 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ff614405-1f2d-4a95-a993-52344c214efb req-d0f5b7d4-7c26-47ce-952d-11a5634cc7f9 service nova] Releasing lock "refresh_cache-7d054231-82b5-43b0-967a-78f5ef690090" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1903593788',display_name='tempest-TestStampPattern-server-1903593788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1903593788',id=36,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeDr8zIgWa3swsi8kRrbrY4v25ZocRcuaJSVAmNSRGFExsScPphVquqvdpzTXj7/U6FNeAF4YkECYqQe9DkYQFF9FKM0cchxIK1gDnEqMzhDHzyT8Y/sy8bS+7J/epnrg==',key_name='tempest-TestStampPattern-615359145',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:40:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e104a96f426475395c2074a5f84f5c5',ramdisk_id='',reservation_id='r-2ybvdwct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-885621001',owner_user_name='tempest-TestStampPattern-885621001-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:44:11Z,user_data=None,user_id='57812f43f52442b78301056926451ad2',uuid=7d054231-82b5-43b0-967a-78f5ef690090,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "address": "fa:16:3e:15:0a:74", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a12c3d-09", "ovs_interfaceid": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Converting VIF {"id": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "address": "fa:16:3e:15:0a:74", "network": {"id": "6df5c46f-af5e-4d93-a9fa-5224b27e5da1", "bridge": "br-int", "label": "tempest-TestStampPattern-434216979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e104a96f426475395c2074a5f84f5c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a12c3d-09", "ovs_interfaceid": "d2a12c3d-09d4-4648-8ad3-11e5e77e2837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:0a:74,bridge_name='br-int',has_traffic_filtering=True,id=d2a12c3d-09d4-4648-8ad3-11e5e77e2837,network=Network(6df5c46f-af5e-4d93-a9fa-5224b27e5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a12c3d-09') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG os_vif [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:0a:74,bridge_name='br-int',has_traffic_filtering=True,id=d2a12c3d-09d4-4648-8ad3-11e5e77e2837,network=Network(6df5c46f-af5e-4d93-a9fa-5224b27e5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a12c3d-09') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2a12c3d-09, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b95ccd1-5ba6-46bc-afe8-761c4ca52e41) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:36 user nova-compute[75018]: INFO os_vif [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:0a:74,bridge_name='br-int',has_traffic_filtering=True,id=d2a12c3d-09d4-4648-8ad3-11e5e77e2837,network=Network(6df5c46f-af5e-4d93-a9fa-5224b27e5da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a12c3d-09')
Nov 07 15:48:36 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Deleting instance files /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090_del
Nov 07 15:48:36 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Deletion of /opt/stack/data/nova/instances/7d054231-82b5-43b0-967a-78f5ef690090_del complete
Nov 07 15:48:37 user nova-compute[75018]: INFO nova.compute.manager [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 07 15:48:37 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:48:37 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:48:37 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:48:37 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:48:37 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Took 0.56 seconds to deallocate network for instance.
Nov 07 15:48:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:37 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:48:37 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:48:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:37 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Deleted allocations for instance 7d054231-82b5-43b0-967a-78f5ef690090
Nov 07 15:48:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-cb7fe546-4167-4ec7-b6dd-1279eb19fed4 tempest-TestStampPattern-885621001 tempest-TestStampPattern-885621001-project-member] Lock "7d054231-82b5-43b0-967a-78f5ef690090" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.901s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:38 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:48:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-a9ca4324-6c0c-4b69-a6e8-1e25f3cd750d req-13dcbb6d-019b-4368-bb05-152d06e22fb0 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Received event network-vif-plugged-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a9ca4324-6c0c-4b69-a6e8-1e25f3cd750d req-13dcbb6d-019b-4368-bb05-152d06e22fb0 service nova] Acquiring lock "7d054231-82b5-43b0-967a-78f5ef690090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a9ca4324-6c0c-4b69-a6e8-1e25f3cd750d req-13dcbb6d-019b-4368-bb05-152d06e22fb0 service nova] Lock "7d054231-82b5-43b0-967a-78f5ef690090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a9ca4324-6c0c-4b69-a6e8-1e25f3cd750d req-13dcbb6d-019b-4368-bb05-152d06e22fb0 service nova] Lock "7d054231-82b5-43b0-967a-78f5ef690090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-a9ca4324-6c0c-4b69-a6e8-1e25f3cd750d req-13dcbb6d-019b-4368-bb05-152d06e22fb0 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] No waiting events found dispatching network-vif-plugged-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:48:39 user nova-compute[75018]: WARNING nova.compute.manager [req-a9ca4324-6c0c-4b69-a6e8-1e25f3cd750d req-13dcbb6d-019b-4368-bb05-152d06e22fb0 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Received unexpected event network-vif-plugged-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 for instance with vm_state deleted and task_state None.
Nov 07 15:48:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-a9ca4324-6c0c-4b69-a6e8-1e25f3cd750d req-13dcbb6d-019b-4368-bb05-152d06e22fb0 service nova] [instance: 7d054231-82b5-43b0-967a-78f5ef690090] Received event network-vif-deleted-d2a12c3d-09d4-4648-8ad3-11e5e77e2837 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:39 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:48:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:41 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:48:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:48:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:42 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:48:43 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:48:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:48:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:48:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:48:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:48:44 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updating instance_info_cache with network_info: [{"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:48:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:48:44 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:48:45 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:48:46 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:48:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:47 user nova-compute[75018]: INFO nova.compute.manager [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Rebooting instance
Nov 07 15:48:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquired lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG nova.network.neutron [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-3814f090-dcb0-4c94-bc7a-f70b05188ac0 req-dbc30667-a09f-4569-a77b-e5064f89f1ec service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-changed-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-3814f090-dcb0-4c94-bc7a-f70b05188ac0 req-dbc30667-a09f-4569-a77b-e5064f89f1ec service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Refreshing instance network info cache due to event network-changed-74fe6639-8825-4ac6-ad52-3c5a6773857f. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3814f090-dcb0-4c94-bc7a-f70b05188ac0 req-dbc30667-a09f-4569-a77b-e5064f89f1ec service nova] Acquiring lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3814f090-dcb0-4c94-bc7a-f70b05188ac0 req-dbc30667-a09f-4569-a77b-e5064f89f1ec service nova] Acquired lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG nova.network.neutron [req-3814f090-dcb0-4c94-bc7a-f70b05188ac0 req-dbc30667-a09f-4569-a77b-e5064f89f1ec service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Refreshing network info cache for port 74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG nova.network.neutron [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updating instance_info_cache with network_info: [{"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Releasing lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "1013f68f-ef99-4544-a3ce-d5f731b41606" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:47 user nova-compute[75018]: INFO nova.compute.manager [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Terminating instance
Nov 07 15:48:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-35ea5e9e-7bf6-4a48-bcc8-ec68026b50c1 req-27bd7796-75e4-4c7a-b573-1855888cf423 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-vif-unplugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-35ea5e9e-7bf6-4a48-bcc8-ec68026b50c1 req-27bd7796-75e4-4c7a-b573-1855888cf423 service nova] Acquiring lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-35ea5e9e-7bf6-4a48-bcc8-ec68026b50c1 req-27bd7796-75e4-4c7a-b573-1855888cf423 service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-35ea5e9e-7bf6-4a48-bcc8-ec68026b50c1 req-27bd7796-75e4-4c7a-b573-1855888cf423 service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-35ea5e9e-7bf6-4a48-bcc8-ec68026b50c1 req-27bd7796-75e4-4c7a-b573-1855888cf423 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] No waiting events found dispatching network-vif-unplugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-35ea5e9e-7bf6-4a48-bcc8-ec68026b50c1 req-27bd7796-75e4-4c7a-b573-1855888cf423 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-vif-unplugged-74fe6639-8825-4ac6-ad52-3c5a6773857f for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG nova.network.neutron [req-3814f090-dcb0-4c94-bc7a-f70b05188ac0 req-dbc30667-a09f-4569-a77b-e5064f89f1ec service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updated VIF entry in instance network info cache for port 74fe6639-8825-4ac6-ad52-3c5a6773857f. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG nova.network.neutron [req-3814f090-dcb0-4c94-bc7a-f70b05188ac0 req-dbc30667-a09f-4569-a77b-e5064f89f1ec service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updating instance_info_cache with network_info: [{"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3814f090-dcb0-4c94-bc7a-f70b05188ac0 req-dbc30667-a09f-4569-a77b-e5064f89f1ec service nova] Releasing lock "refresh_cache-1013f68f-ef99-4544-a3ce-d5f731b41606" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-6aceb28c-ff18-4704-b9a0-d67f572471c3 req-42cbc8c1-28ae-4cd7-ac79-e749a5911268 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-vif-unplugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6aceb28c-ff18-4704-b9a0-d67f572471c3 req-42cbc8c1-28ae-4cd7-ac79-e749a5911268 service nova] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6aceb28c-ff18-4704-b9a0-d67f572471c3 req-42cbc8c1-28ae-4cd7-ac79-e749a5911268 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6aceb28c-ff18-4704-b9a0-d67f572471c3 req-42cbc8c1-28ae-4cd7-ac79-e749a5911268 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:48 user nova-compute[75018]: DEBUG nova.compute.manager [req-6aceb28c-ff18-4704-b9a0-d67f572471c3 req-42cbc8c1-28ae-4cd7-ac79-e749a5911268 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] No waiting events found dispatching network-vif-unplugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:48:48 user nova-compute[75018]: WARNING nova.compute.manager [req-6aceb28c-ff18-4704-b9a0-d67f572471c3 req-42cbc8c1-28ae-4cd7-ac79-e749a5911268 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received unexpected event network-vif-unplugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb for instance with vm_state active and task_state reboot_started_hard.
Nov 07 15:48:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Instance destroyed successfully.
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.objects.instance [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lazy-loading 'resources' on Instance uuid 1013f68f-ef99-4544-a3ce-d5f731b41606 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:48:49 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Instance destroyed successfully.
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.objects.instance [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'resources' on Instance uuid 2ffc6cf3-fb96-48b1-9783-6434e107f09e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T15:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-465451204',display_name='tempest-TestShelveInstance-server-465451204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-465451204',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuVrEFrwEj6OeOOAGIW8mZfqkBlLHl15boYTLN4+rcHDOhOesO3XWH7Ay0ZCO8ZExQ4Qyy6ptmZx4rXdAah8ySoRuw/DOtcmuwWoHoxlfWmN131iGvvcoSdfQFQfrQe3A==',key_name='tempest-TestShelveInstance-486488334',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:47:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0f296caee0c4c87acaf64774de69cfb',ramdisk_id='',reservation_id='r-p7bfb4yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1838376973',owner_user_name='tempest-TestShelveInstance-1838376973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:47:27Z,user_data=None,user_id='078ecf188a31491c9841224829899661',uuid=1013f68f-ef99-4544-a3ce-d5f731b41606,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Converting VIF {"id": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "address": "fa:16:3e:66:6d:4b", "network": {"id": "1ec84201-4506-4c97-8ea5-9536271fb4f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1024873285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0f296caee0c4c87acaf64774de69cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fe6639-88", "ovs_interfaceid": "74fe6639-8825-4ac6-ad52-3c5a6773857f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=74fe6639-8825-4ac6-ad52-3c5a6773857f,network=Network(1ec84201-4506-4c97-8ea5-9536271fb4f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fe6639-88') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_vif [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=74fe6639-8825-4ac6-ad52-3c5a6773857f,network=Network(1ec84201-4506-4c97-8ea5-9536271fb4f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fe6639-88') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74fe6639-88, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f95dcf64-e675-4378-845a-92fae7a4568b) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: INFO os_vif [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=74fe6639-8825-4ac6-ad52-3c5a6773857f,network=Network(1ec84201-4506-4c97-8ea5-9536271fb4f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fe6639-88')
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgnlWfCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:48:49 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2007259099',display_name='tempest-TestMinimumBasicScenario-server-2007259099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2007259099',id=41,image_ref='cb5b3cf6-9c69-4273-8104-16e4fb6c2f16',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5HG2OdhSPmgIIlNgxbkQ96mEDjXH0cLhbCGyYUW1ZSJYR9IWY1NlFSNWNSR94SssE5COVhVs4rfpnjk/C8eZPku/sBzb/THjU+EqbM57rp2A+oFnjHZA4xyojEOlC9Cw==',key_name='tempest-TestMinimumBasicScenario-1546028479',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:45:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e9055a2f9df4fc1867db5de885f5430',ramdisk_id='',reservation_id='r-ysspxro3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb5b3cf6-9c69-4273-8104-16e4fb6c2f16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-376924718',owner_user_name='tempest-TestMinimumBasicScenario-376924718-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:48:48Z,user_data=None,user_id='d4927e184ba449c493a60d9580755235',uuid=2ffc6cf3-fb96-48b1-9783-6434e107f09e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converting VIF {"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3f:4c,bridge_name='br-int',has_traffic_filtering=True,id=fba78b12-1ec4-4b48-b972-fabe6eb861cb,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba78b12-1e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_vif [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3f:4c,bridge_name='br-int',has_traffic_filtering=True,id=fba78b12-1ec4-4b48-b972-fabe6eb861cb,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba78b12-1e') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfba78b12-1e, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3355d17-da3c-4366-aec3-22cccd357513]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:48:49 user nova-compute[75018]: No targets found.
Nov 07 15:48:49 user nova-compute[75018]: iSNS:
Nov 07 15:48:49 user nova-compute[75018]: No targets found.
Nov 07 15:48:49 user nova-compute[75018]: STATIC:
Nov 07 15:48:49 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89
Nov 07 15:48:49 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:48:49 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:48:49 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d
Nov 07 15:48:49 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:48:49 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:48:49 user nova-compute[75018]: FIRMWARE:
Nov 07 15:48:49 user nova-compute[75018]: No targets found.
Nov 07 15:48:49 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:48:49 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:48:49 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6b2d152-0cb0-4ca2-9ab8-7ebe09e66096) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:48:49 user nova-compute[75018]: INFO os_vif [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3f:4c,bridge_name='br-int',has_traffic_filtering=True,id=fba78b12-1ec4-4b48-b972-fabe6eb861cb,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba78b12-1e')
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhIgDUCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:48:49 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.038s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b836c8c-4beb-4203-a6de-88eda952f465]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b46573-bc2f-43ae-a4a4-7797a82a99ce]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:48:49 user nova-compute[75018]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:48:49 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 (non-flash)
Nov 07 15:48:49 user nova-compute[75018]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:48:49 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feaf81f1360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7884c352-c71a-463d-a8c5-7add9139522b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b3116c-4e69-4ae1-a549-ec7b1a3cf22d]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb08819-c83c-4412-816f-4e8bf0e52676]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84740f1-c45d-4271-af2a-e0bf7b40bb3c]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbc7366-20a8-4e4d-8dab-d1821db2e689]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d18de4b-000c-4968-90fb-fa19f22f560b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260]
Nov 07 15:48:49 user nova-compute[75018]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89, portal: 172.16.0.220,3260] successful.
Nov 07 15:48:49 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94213c4a-0df9-472e-9256-187bbe0d8c89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[21791691-c3f1-4122-b3f8-eca536c3f936]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] <== disconnect_volume: return (431ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:48:49 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Deleting instance files /opt/stack/data/nova/instances/1013f68f-ef99-4544-a3ce-d5f731b41606_del
Nov 07 15:48:49 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Deletion of /opt/stack/data/nova/instances/1013f68f-ef99-4544-a3ce-d5f731b41606_del complete
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.370s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6ed87c-1a22-4d36-bde7-58e76face089]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:48:49 user nova-compute[75018]: No targets found.
Nov 07 15:48:49 user nova-compute[75018]: iSNS:
Nov 07 15:48:49 user nova-compute[75018]: No targets found.
Nov 07 15:48:49 user nova-compute[75018]: STATIC:
Nov 07 15:48:49 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d
Nov 07 15:48:49 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:48:49 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:48:49 user nova-compute[75018]: FIRMWARE:
Nov 07 15:48:49 user nova-compute[75018]: No targets found.
Nov 07 15:48:49 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:48:49 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:48:49 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a5c26b-da16-45c5-ae18-7ad64ef10359]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c87e42-92ff-4741-aa75-ab61b0793809]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:48:49 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:48:49 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae02b6dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d'): ({'sdd'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Removing single pathed devices sdd {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:48:49 user nova-compute[75018]: INFO nova.compute.manager [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Took 1.88 seconds to destroy the instance on the hypervisor.
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acd7b68-62cb-4837-ab0e-d8f13c71d3a2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5297cf-ccff-4506-b76c-945b1442b25f]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Flushing IO for device /dev/sdd {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcd265f-3d36-46f1-96ee-e6d26a84f6a1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[044a3d8d-2d88-4f7a-a312-2b336d7c91b6]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] SCSI volumes sdd have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bda1d2d-e8ad-4063-92f5-c0b930ea47ed]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a143331d-761a-448d-bc79-057087530a52]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260]
Nov 07 15:48:49 user nova-compute[75018]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260] successful.
Nov 07 15:48:49 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b07953f-b4f5-42c9-b8e7-ef88dfddc3b2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] <== disconnect_volume: return (718ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Start _get_guest_xml network_info=[{"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cb5b3cf6-9c69-4273-8104-16e4fb6c2f16,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cb5b3cf6-9c69-4273-8104-16e4fb6c2f16'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhIgDUCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '2ffc6cf3-fb96-48b1-9783-6434e107f09e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2d0cd3b-6433-4b9b-b293-503fe2f4d43d', 'serial': 'c2d0cd3b-6433-4b9b-b293-503fe2f4d43d'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '3437c508-bc0d-4910-aaa3-a1db0abd0325', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:48:49 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:48:49 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cb5b3cf6-9c69-4273-8104-16e4fb6c2f16,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.objects.instance [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2ffc6cf3-fb96-48b1-9783-6434e107f09e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:48:49 user nova-compute[75018]: DEBUG nova.objects.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Object Instance<2ffc6cf3-fb96-48b1-9783-6434e107f09e> lazy-loaded attributes: resources,vcpu_model {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhIgDUCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:48:50 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:48:50 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:48:50 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8ae402-9578-44ac-83f3-bb1378b5a799]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:48:50 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-1cce0679-a373-4d62-b9ba-fc5017f9d49a req-a353a22e-c668-4d89-b667-854f1abedd54 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1cce0679-a373-4d62-b9ba-fc5017f9d49a req-a353a22e-c668-4d89-b667-854f1abedd54 service nova] Acquiring lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1cce0679-a373-4d62-b9ba-fc5017f9d49a req-a353a22e-c668-4d89-b667-854f1abedd54 service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1cce0679-a373-4d62-b9ba-fc5017f9d49a req-a353a22e-c668-4d89-b667-854f1abedd54 service nova] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-1cce0679-a373-4d62-b9ba-fc5017f9d49a req-a353a22e-c668-4d89-b667-854f1abedd54 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] No waiting events found dispatching network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:48:50 user nova-compute[75018]: WARNING nova.compute.manager [req-1cce0679-a373-4d62-b9ba-fc5017f9d49a req-a353a22e-c668-4d89-b667-854f1abedd54 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received unexpected event network-vif-plugged-74fe6639-8825-4ac6-ad52-3c5a6773857f for instance with vm_state active and task_state deleting.
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15a97a3-b78f-4fe9-b6d7-f1523cc96c96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d] added
Nov 07 15:48:50 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[648b5b01-0392-4958-aab0-3946ca480df5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd12b95-4061-40cf-ab83-13a5ce668c82]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vhIgDUCT {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vhIgDUCT" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[43853fd6-a580-4830-b088-c166edc3237c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vhIgDUCT'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cef3fea-3611-42d8-8c0c-c9c8ac072b80]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e783bc6-5e76-407b-a06e-f34cb41d7aa9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 15:48:50 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 15:48:50 user nova-compute[75018]:  {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:48:50 user nova-compute[75018]: WARNING os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 15:48:50 user nova-compute[75018]: 
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5116d0f-7afc-4f98-afa3-6d99d66eb245]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260]
Nov 07 15:48:50 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260] successful.
Nov 07 15:48:50 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:50 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Took 0.64 seconds to deallocate network for instance.
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63bf4aa-fac1-4e91-8784-1d26a9b9024b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] No waiting events found dispatching network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:48:50 user nova-compute[75018]: WARNING nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received unexpected event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb for instance with vm_state active and task_state reboot_started_hard.
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] No waiting events found dispatching network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:48:50 user nova-compute[75018]: WARNING nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received unexpected event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb for instance with vm_state active and task_state reboot_started_hard.
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] No waiting events found dispatching network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:48:50 user nova-compute[75018]: WARNING nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received unexpected event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb for instance with vm_state active and task_state reboot_started_hard.
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-vif-unplugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] No waiting events found dispatching network-vif-unplugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:48:50 user nova-compute[75018]: WARNING nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received unexpected event network-vif-unplugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb for instance with vm_state active and task_state reboot_started_hard.
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] No waiting events found dispatching network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:48:50 user nova-compute[75018]: WARNING nova.compute.manager [req-06ddb95c-37dd-4f0b-86c0-3a9e6af98daa req-011dc342-837f-4efb-86a1-ddccfa1bf8c2 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received unexpected event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb for instance with vm_state active and task_state reboot_started_hard.
Nov 07 15:48:50 user nova-compute[75018]: DEBUG nova.compute.manager [req-f1cd1107-c328-4735-9a8d-72b07a75461f req-307169b7-8fca-4748-98f9-3a13043047b0 service nova] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Received event network-vif-deleted-74fe6639-8825-4ac6-ad52-3c5a6773857f {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1a0dcd-9d26-4e08-b56d-a1b65585e139]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:48:50 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:48:50 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee73e9d9-936c-458f-bda0-ac3ee4f44370]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhIgDUCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:48:50 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:51 user nova-compute[75018]: INFO nova.compute.manager [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Took 0.98 seconds to detach 1 volumes for instance.
Nov 07 15:48:51 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] [instance: 1013f68f-ef99-4544-a3ce-d5f731b41606] Deleting volume: 94213c4a-0df9-472e-9256-187bbe0d8c89 {{(pid=75018) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23961613335623764', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961613335623764', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2007259099',display_name='tempest-TestMinimumBasicScenario-server-2007259099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2007259099',id=41,image_ref='cb5b3cf6-9c69-4273-8104-16e4fb6c2f16',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5HG2OdhSPmgIIlNgxbkQ96mEDjXH0cLhbCGyYUW1ZSJYR9IWY1NlFSNWNSR94SssE5COVhVs4rfpnjk/C8eZPku/sBzb/THjU+EqbM57rp2A+oFnjHZA4xyojEOlC9Cw==',key_name='tempest-TestMinimumBasicScenario-1546028479',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:45:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e9055a2f9df4fc1867db5de885f5430',ramdisk_id='',reservation_id='r-ysspxro3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb5b3cf6-9c69-4273-8104-16e4fb6c2f16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-376924718',owner_user_name='tempest-TestMinimumBasicScenario-376924718-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:48:48Z,user_data=None,user_id='d4927e184ba449c493a60d9580755235',uuid=2ffc6cf3-fb96-48b1-9783-6434e107f09e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converting VIF {"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3f:4c,bridge_name='br-int',has_traffic_filtering=True,id=fba78b12-1ec4-4b48-b972-fabe6eb861cb,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba78b12-1e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG nova.objects.instance [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ffc6cf3-fb96-48b1-9783-6434e107f09e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG nova.objects.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Object Instance<2ffc6cf3-fb96-48b1-9783-6434e107f09e> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:48:51 user nova-compute[75018]:   <uuid>2ffc6cf3-fb96-48b1-9783-6434e107f09e</uuid>
Nov 07 15:48:51 user nova-compute[75018]:   <name>instance-00000029</name>
Nov 07 15:48:51 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:48:51 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:48:51 user nova-compute[75018]:   <metadata>
Nov 07 15:48:51 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:48:51 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:48:51 user nova-compute[75018]:       <nova:name>tempest-TestMinimumBasicScenario-server-2007259099</nova:name>
Nov 07 15:48:51 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:48:49</nova:creationTime>
Nov 07 15:48:51 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:48:51 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:48:51 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:48:51 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:48:51 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:48:51 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:48:51 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:48:51 user nova-compute[75018]:       <nova:owner>
Nov 07 15:48:51 user nova-compute[75018]:         <nova:user uuid="d4927e184ba449c493a60d9580755235">tempest-TestMinimumBasicScenario-376924718-project-member</nova:user>
Nov 07 15:48:51 user nova-compute[75018]:         <nova:project uuid="1e9055a2f9df4fc1867db5de885f5430">tempest-TestMinimumBasicScenario-376924718</nova:project>
Nov 07 15:48:51 user nova-compute[75018]:       </nova:owner>
Nov 07 15:48:51 user nova-compute[75018]:       <nova:root type="image" uuid="cb5b3cf6-9c69-4273-8104-16e4fb6c2f16"/>
Nov 07 15:48:51 user nova-compute[75018]:       <nova:ports>
Nov 07 15:48:51 user nova-compute[75018]:         <nova:port uuid="fba78b12-1ec4-4b48-b972-fabe6eb861cb">
Nov 07 15:48:51 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 07 15:48:51 user nova-compute[75018]:         </nova:port>
Nov 07 15:48:51 user nova-compute[75018]:       </nova:ports>
Nov 07 15:48:51 user nova-compute[75018]:     </nova:instance>
Nov 07 15:48:51 user nova-compute[75018]:   </metadata>
Nov 07 15:48:51 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:48:51 user nova-compute[75018]:     <system>
Nov 07 15:48:51 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:48:51 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:48:51 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:48:51 user nova-compute[75018]:       <entry name="serial">2ffc6cf3-fb96-48b1-9783-6434e107f09e</entry>
Nov 07 15:48:51 user nova-compute[75018]:       <entry name="uuid">2ffc6cf3-fb96-48b1-9783-6434e107f09e</entry>
Nov 07 15:48:51 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:48:51 user nova-compute[75018]:     </system>
Nov 07 15:48:51 user nova-compute[75018]:   </sysinfo>
Nov 07 15:48:51 user nova-compute[75018]:   <os>
Nov 07 15:48:51 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:48:51 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:48:51 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:48:51 user nova-compute[75018]:   </os>
Nov 07 15:48:51 user nova-compute[75018]:   <features>
Nov 07 15:48:51 user nova-compute[75018]:     <acpi/>
Nov 07 15:48:51 user nova-compute[75018]:     <apic/>
Nov 07 15:48:51 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:48:51 user nova-compute[75018]:   </features>
Nov 07 15:48:51 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:48:51 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:48:51 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:48:51 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:48:51 user nova-compute[75018]:   </clock>
Nov 07 15:48:51 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:48:51 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:48:51 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:48:51 user nova-compute[75018]:   </cpu>
Nov 07 15:48:51 user nova-compute[75018]:   <devices>
Nov 07 15:48:51 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:48:51 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:48:51 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk"/>
Nov 07 15:48:51 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:48:51 user nova-compute[75018]:     </disk>
Nov 07 15:48:51 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:48:51 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:48:51 user nova-compute[75018]:       <source dev="/dev/sdb"/>
Nov 07 15:48:51 user nova-compute[75018]:       <target dev="vdb" bus="virtio"/>
Nov 07 15:48:51 user nova-compute[75018]:       <serial>c2d0cd3b-6433-4b9b-b293-503fe2f4d43d</serial>
Nov 07 15:48:51 user nova-compute[75018]:     </disk>
Nov 07 15:48:51 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:48:51 user nova-compute[75018]:       <mac address="fa:16:3e:e3:3f:4c"/>
Nov 07 15:48:51 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:48:51 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:48:51 user nova-compute[75018]:       <target dev="tapfba78b12-1e"/>
Nov 07 15:48:51 user nova-compute[75018]:     </interface>
Nov 07 15:48:51 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:48:51 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/console.log" append="off"/>
Nov 07 15:48:51 user nova-compute[75018]:     </serial>
Nov 07 15:48:51 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:48:51 user nova-compute[75018]:     <video>
Nov 07 15:48:51 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:48:51 user nova-compute[75018]:     </video>
Nov 07 15:48:51 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:48:51 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:48:51 user nova-compute[75018]:     </rng>
Nov 07 15:48:51 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:48:51 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:48:51 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:48:51 user nova-compute[75018]:     </memballoon>
Nov 07 15:48:51 user nova-compute[75018]:   </devices>
Nov 07 15:48:51 user nova-compute[75018]: </domain>
Nov 07 15:48:51 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.013s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:48:51 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Deleted allocations for instance 1013f68f-ef99-4544-a3ce-d5f731b41606
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG nova.objects.instance [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2ffc6cf3-fb96-48b1-9783-6434e107f09e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b0dce3bf-2256-4425-a9ba-76f547236536 tempest-TestShelveInstance-1838376973 tempest-TestShelveInstance-1838376973-project-member] Lock "1013f68f-ef99-4544-a3ce-d5f731b41606" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.082s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG nova.objects.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Object Instance<2ffc6cf3-fb96-48b1-9783-6434e107f09e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:51 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4 --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Cannot resize image /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG nova.objects.instance [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'migration_context' on Instance uuid 2ffc6cf3-fb96-48b1-9783-6434e107f09e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG nova.objects.base [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Object Instance<2ffc6cf3-fb96-48b1-9783-6434e107f09e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2007259099',display_name='tempest-TestMinimumBasicScenario-server-2007259099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2007259099',id=41,image_ref='cb5b3cf6-9c69-4273-8104-16e4fb6c2f16',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5HG2OdhSPmgIIlNgxbkQ96mEDjXH0cLhbCGyYUW1ZSJYR9IWY1NlFSNWNSR94SssE5COVhVs4rfpnjk/C8eZPku/sBzb/THjU+EqbM57rp2A+oFnjHZA4xyojEOlC9Cw==',key_name='tempest-TestMinimumBasicScenario-1546028479',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:45:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='1e9055a2f9df4fc1867db5de885f5430',ramdisk_id='',reservation_id='r-ysspxro3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb5b3cf6-9c69-4273-8104-16e4fb6c2f16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-376924718',owner_user_name='tempest-TestMinimumBasicScenario-376924718-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:48:48Z,user_data=None,user_id='d4927e184ba449c493a60d9580755235',uuid=2ffc6cf3-fb96-48b1-9783-6434e107f09e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converting VIF {"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3f:4c,bridge_name='br-int',has_traffic_filtering=True,id=fba78b12-1ec4-4b48-b972-fabe6eb861cb,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba78b12-1e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG os_vif [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3f:4c,bridge_name='br-int',has_traffic_filtering=True,id=fba78b12-1ec4-4b48-b972-fabe6eb861cb,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba78b12-1e') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e99539ea-af2e-5f81-bfc4-356e1f11c784', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfba78b12-1e, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfba78b12-1e, col_values=(('qos', UUID('8a61d3d1-25f9-48c7-a226-30c6b2a34a18')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfba78b12-1e, col_values=(('external_ids', {'iface-id': 'fba78b12-1ec4-4b48-b972-fabe6eb861cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:3f:4c', 'vm-uuid': '2ffc6cf3-fb96-48b1-9783-6434e107f09e'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:52 user nova-compute[75018]: INFO os_vif [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3f:4c,bridge_name='br-int',has_traffic_filtering=True,id=fba78b12-1ec4-4b48-b972-fabe6eb861cb,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba78b12-1e')
Nov 07 15:48:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:48:52 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:48:52 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:48:52 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8524MB free_disk=24.962913513183594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 64559109-6166-488d-a457-20b5f01ddf40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 2ffc6cf3-fb96-48b1-9783-6434e107f09e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-ae97ee15-ec22-4b8c-b540-4612faabcd04 req-5fc9302a-89d8-4c13-b72f-f0c41b0b32e6 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ae97ee15-ec22-4b8c-b540-4612faabcd04 req-5fc9302a-89d8-4c13-b72f-f0c41b0b32e6 service nova] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ae97ee15-ec22-4b8c-b540-4612faabcd04 req-5fc9302a-89d8-4c13-b72f-f0c41b0b32e6 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ae97ee15-ec22-4b8c-b540-4612faabcd04 req-5fc9302a-89d8-4c13-b72f-f0c41b0b32e6 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-ae97ee15-ec22-4b8c-b540-4612faabcd04 req-5fc9302a-89d8-4c13-b72f-f0c41b0b32e6 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] No waiting events found dispatching network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:48:53 user nova-compute[75018]: WARNING nova.compute.manager [req-ae97ee15-ec22-4b8c-b540-4612faabcd04 req-5fc9302a-89d8-4c13-b72f-f0c41b0b32e6 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received unexpected event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb for instance with vm_state active and task_state reboot_started_hard.
Nov 07 15:48:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:48:55 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Instance rebooted successfully.
Nov 07 15:48:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:48:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-11a7e5f1-d794-480d-bf7a-ffdbc4c5a9cc tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.879s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-42e19c22-2ff8-4198-a28f-1873b81f86de req-6ad3a193-fbdd-401f-8886-1743f6161b45 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:48:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-42e19c22-2ff8-4198-a28f-1873b81f86de req-6ad3a193-fbdd-401f-8886-1743f6161b45 service nova] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:48:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-42e19c22-2ff8-4198-a28f-1873b81f86de req-6ad3a193-fbdd-401f-8886-1743f6161b45 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:48:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-42e19c22-2ff8-4198-a28f-1873b81f86de req-6ad3a193-fbdd-401f-8886-1743f6161b45 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:48:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-42e19c22-2ff8-4198-a28f-1873b81f86de req-6ad3a193-fbdd-401f-8886-1743f6161b45 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] No waiting events found dispatching network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:48:55 user nova-compute[75018]: WARNING nova.compute.manager [req-42e19c22-2ff8-4198-a28f-1873b81f86de req-6ad3a193-fbdd-401f-8886-1743f6161b45 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received unexpected event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb for instance with vm_state active and task_state None.
Nov 07 15:48:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:48:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:49:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG nova.objects.instance [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lazy-loading 'flavor' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:49:08 user nova-compute[75018]: INFO nova.compute.manager [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Attaching volume 7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 to /dev/vdb
Nov 07 15:49:08 user nova-compute[75018]: DEBUG os_brick.utils [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4090de8e-5bfc-4de5-993c-4a171bc950d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d223aeb1-1a08-4a4a-8d99-9dfe020358f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b8214f-2b35-4b79-ae98-68eb9315350e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc81b02b-b9c8-408d-b35e-502db8f0c6e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:49:08 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:49:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[565471e2-dc41-4d8a-8af2-83f6155df56d]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG os_brick.utils [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:49:08 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updating existing volume attachment record: 5611a9e1-9e81-4106-b7b4-247b64d006f0 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:49:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJkXNHVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:49:30 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:49:30 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:49:30 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f916b2-ae88-457e-b282-0fb1c26d9fc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:49:30 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e8dd08-491e-4272-9345-3486c0d3b6ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460] added
Nov 07 15:49:30 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[946f1af3-34e6-410d-8fba-9db568e5cd5c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdf3110-1716-4de8-a457-2fc4266e31ec]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJkXNHVv {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJkXNHVv" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[addaa29b-dcc6-41ba-923f-03c1492c3aeb]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tJkXNHVv'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ceb955-a9a2-4387-beed-172bc9fb3b9e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6d5185-1361-4c14-adaa-018ad291f3e5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:49:30 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:49:30 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46a1dd7-7580-496e-b9f1-e57ce049f6b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460, portal: 172.16.0.220,3260]
Nov 07 15:49:30 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460, portal: 172.16.0.220,3260] successful.
Nov 07 15:49:30 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[09563344-b747-4df8-8905-3c874410ab71]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[808b7af7-3808-4b8a-9f99-c0601695fe17]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:49:30 user nova-compute[75018]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 (non-flash)
Nov 07 15:49:30 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:49:30 user nova-compute[75018]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 (non-flash)
Nov 07 15:49:30 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fdb032-e70c-40fa-84fb-c5c88213c452]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:30 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:49:31 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:49:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJkXNHVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:49:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:49:31 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23164386435323634', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:49:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164386435323634', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:49:31 user nova-compute[75018]: DEBUG nova.objects.instance [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lazy-loading 'flavor' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:49:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:49:31 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:49:31 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:49:31 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:49:31 user nova-compute[75018]:   <serial>7b5c18d5-e4aa-4a7b-b35a-10afa56d6460</serial>
Nov 07 15:49:31 user nova-compute[75018]: </disk>
Nov 07 15:49:31 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:49:31 user nova-compute[75018]: DEBUG nova.compute.manager [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:49:31 user nova-compute[75018]: INFO nova.compute.manager [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] instance snapshotting
Nov 07 15:49:31 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Beginning live snapshot process
Nov 07 15:49:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:49:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:49:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] No VIF found with MAC fa:16:3e:9a:04:46, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:49:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json -f qcow2 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-39f83e8e-7fd1-4953-8d19-edd90d54247b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.679s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:49:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json -f qcow2 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:49:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json -f qcow2" returned: 0 in 0.198s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsmecwhk3/69d89ef9db664e00a112bd2b4be53b47.delta 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsmecwhk3/69d89ef9db664e00a112bd2b4be53b47.delta 1073741824" returned: 0 in 0.056s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:32 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 07 15:49:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75018) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 15:49:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75018) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 15:49:33 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 07 15:49:34 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:49:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsmecwhk3/69d89ef9db664e00a112bd2b4be53b47.delta /opt/stack/data/nova/instances/snapshots/tmpsmecwhk3/69d89ef9db664e00a112bd2b4be53b47 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsmecwhk3/69d89ef9db664e00a112bd2b4be53b47.delta /opt/stack/data/nova/instances/snapshots/tmpsmecwhk3/69d89ef9db664e00a112bd2b4be53b47" returned: 0 in 0.356s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:34 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Snapshot extracted, beginning image upload
Nov 07 15:49:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:49:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:49:35 user nova-compute[75018]: INFO nova.compute.manager [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Detaching volume 7b5c18d5-e4aa-4a7b-b35a-10afa56d6460
Nov 07 15:49:35 user nova-compute[75018]: INFO nova.virt.block_device [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Attempting to driver detach volume 7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 from mountpoint /dev/vdb
Nov 07 15:49:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Attempting to detach device vdb from instance 64559109-6166-488d-a457-20b5f01ddf40 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:49:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:49:35 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:49:35 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:49:35 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:49:35 user nova-compute[75018]:   <serial>7b5c18d5-e4aa-4a7b-b35a-10afa56d6460</serial>
Nov 07 15:49:35 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:49:35 user nova-compute[75018]: </disk>
Nov 07 15:49:35 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:49:35 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Successfully detached device vdb from instance 64559109-6166-488d-a457-20b5f01ddf40 from the persistent domain config.
Nov 07 15:49:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64559109-6166-488d-a457-20b5f01ddf40 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:49:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:49:35 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:49:35 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:49:35 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:49:35 user nova-compute[75018]:   <serial>7b5c18d5-e4aa-4a7b-b35a-10afa56d6460</serial>
Nov 07 15:49:35 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:49:35 user nova-compute[75018]: </disk>
Nov 07 15:49:35 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:49:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:49:36 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:49:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:37 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Snapshot image upload complete
Nov 07 15:49:37 user nova-compute[75018]: INFO nova.compute.manager [None req-009db74a-b76d-4643-a3fe-07f4aa33b300 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Took 5.45 seconds to snapshot the instance on the hypervisor.
Nov 07 15:49:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:38 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:49:40 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:49:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:41 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:49:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:49:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:43 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:49:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:45 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:49:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:49:45 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 15:49:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:49:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:49:45 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:49:45 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:49:46 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updating instance_info_cache with network_info: [{"id": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "address": "fa:16:3e:9a:04:46", "network": {"id": "a71702a4-b590-4647-8237-28eb0fcd9230", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1031019268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c836eb1cc36a4724995e31466a2a8c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f42a26-dd", "ovs_interfaceid": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:49:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:49:46 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:49:46 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:49:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:49:48 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:49:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:49:53 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:49:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:49:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:49:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:49:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:49:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:54 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:49:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:49:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:49:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8575MB free_disk=24.902244567871094GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 64559109-6166-488d-a457-20b5f01ddf40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 2ffc6cf3-fb96-48b1-9783-6434e107f09e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:49:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 64559109-6166-488d-a457-20b5f01ddf40 is timed out.
Nov 07 15:49:55 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Successfully detached device vdb from instance 64559109-6166-488d-a457-20b5f01ddf40 from the live domain config.
Nov 07 15:49:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJkXNHVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:49:55 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd364eb-0864-4c9a-8fa4-bb7c1f379f96]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:49:55 user nova-compute[75018]: No targets found.
Nov 07 15:49:55 user nova-compute[75018]: iSNS:
Nov 07 15:49:55 user nova-compute[75018]: No targets found.
Nov 07 15:49:55 user nova-compute[75018]: STATIC:
Nov 07 15:49:55 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460
Nov 07 15:49:55 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:49:55 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:49:55 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d
Nov 07 15:49:55 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:49:55 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:49:55 user nova-compute[75018]: FIRMWARE:
Nov 07 15:49:55 user nova-compute[75018]: No targets found.
Nov 07 15:49:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:49:55 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:49:55 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[52812a64-ccdf-46ea-b517-120c4184f92e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd394e3b-da4f-41a6-86d8-f410fa7dd7b0]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:49:55 user nova-compute[75018]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 (non-flash)
Nov 07 15:49:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:49:55 user nova-compute[75018]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 (non-flash)
Nov 07 15:49:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb0048edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460'): ({'sdc'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Removing single pathed devices sdc {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35ab008-1459-4651-ad3c-771b07b8b25d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe647683-e71a-450b-a4e1-f2e4a18db13c]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Flushing IO for device /dev/sdc {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc09c4f-5695-4088-9a1d-c2f4e6c28065]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c4d9af-30ec-4370-b157-45271f925b0e]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b4624b-e962-4770-ba23-2c7bfa5594c3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aca494-cdcc-439b-9106-4f725da1fc01]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460, portal: 172.16.0.220,3260]
Nov 07 15:49:55 user nova-compute[75018]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460, portal: 172.16.0.220,3260] successful.
Nov 07 15:49:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5c18d5-e4aa-4a7b-b35a-10afa56d6460 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[193ca3f5-d7e6-4b41-953e-fc214f6a34fe]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] <== disconnect_volume: return (354ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:49:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:49:57 user nova-compute[75018]: DEBUG nova.objects.instance [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lazy-loading 'flavor' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:49:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0cb348fb-3aba-4f3e-a978-7ffc7162aa52 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.095s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:49:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:50:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:50:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:50:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:50:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:50:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:50:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:50:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:50:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:50:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:50:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:50:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:50:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:50:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:50:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:50:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:50:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-8992a6a6-65fc-4e13-b0b2-83e8b240e333 req-cfb3424a-c629-4bf8-9247-8f42e8dc7686 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-changed-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:50:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-8992a6a6-65fc-4e13-b0b2-83e8b240e333 req-cfb3424a-c629-4bf8-9247-8f42e8dc7686 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Refreshing instance network info cache due to event network-changed-fba78b12-1ec4-4b48-b972-fabe6eb861cb. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:50:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8992a6a6-65fc-4e13-b0b2-83e8b240e333 req-cfb3424a-c629-4bf8-9247-8f42e8dc7686 service nova] Acquiring lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:50:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8992a6a6-65fc-4e13-b0b2-83e8b240e333 req-cfb3424a-c629-4bf8-9247-8f42e8dc7686 service nova] Acquired lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:50:39 user nova-compute[75018]: DEBUG nova.network.neutron [req-8992a6a6-65fc-4e13-b0b2-83e8b240e333 req-cfb3424a-c629-4bf8-9247-8f42e8dc7686 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Refreshing network info cache for port fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:50:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:50:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:50:39 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:50:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:50:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:50:39 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:50:39 user nova-compute[75018]: INFO nova.compute.claims [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Claim successful on node user
Nov 07 15:50:39 user nova-compute[75018]: DEBUG nova.network.neutron [req-8992a6a6-65fc-4e13-b0b2-83e8b240e333 req-cfb3424a-c629-4bf8-9247-8f42e8dc7686 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updated VIF entry in instance network info cache for port fba78b12-1ec4-4b48-b972-fabe6eb861cb. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:50:39 user nova-compute[75018]: DEBUG nova.network.neutron [req-8992a6a6-65fc-4e13-b0b2-83e8b240e333 req-cfb3424a-c629-4bf8-9247-8f42e8dc7686 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updating instance_info_cache with network_info: [{"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:50:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8992a6a6-65fc-4e13-b0b2-83e8b240e333 req-cfb3424a-c629-4bf8-9247-8f42e8dc7686 service nova] Releasing lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:50:40 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:50:40 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:50:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:50:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:50:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:50:40 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:50:40 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:50:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:50:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:50:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:50:40 user nova-compute[75018]: INFO nova.virt.block_device [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Booting with blank volume at /dev/vda
Nov 07 15:50:40 user nova-compute[75018]: INFO nova.compute.manager [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Detaching volume c2d0cd3b-6433-4b9b-b293-503fe2f4d43d
Nov 07 15:50:40 user nova-compute[75018]: DEBUG nova.policy [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b85e59486dda47eeb7b0cf5ddf732ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b703f914a00c4d5399fbd2a05d855e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:50:40 user nova-compute[75018]: INFO nova.virt.block_device [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Attempting to driver detach volume c2d0cd3b-6433-4b9b-b293-503fe2f4d43d from mountpoint /dev/vdb
Nov 07 15:50:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Attempting to detach device vdb from instance 2ffc6cf3-fb96-48b1-9783-6434e107f09e from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:50:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:50:40 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:50:40 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 15:50:40 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:50:40 user nova-compute[75018]:   <serial>c2d0cd3b-6433-4b9b-b293-503fe2f4d43d</serial>
Nov 07 15:50:40 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 15:50:40 user nova-compute[75018]: </disk>
Nov 07 15:50:40 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:50:40 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Successfully detached device vdb from instance 2ffc6cf3-fb96-48b1-9783-6434e107f09e from the persistent domain config.
Nov 07 15:50:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2ffc6cf3-fb96-48b1-9783-6434e107f09e from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:50:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:50:40 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:50:40 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 15:50:40 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:50:40 user nova-compute[75018]:   <serial>c2d0cd3b-6433-4b9b-b293-503fe2f4d43d</serial>
Nov 07 15:50:40 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 15:50:40 user nova-compute[75018]: </disk>
Nov 07 15:50:40 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:50:40 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:50:40 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:50:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2ffc6cf3-fb96-48b1-9783-6434e107f09e {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Successfully created port: 9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG nova.compute.manager [req-574c8343-2d61-4bcd-a679-35a82b8009b0 req-7859a802-70f8-40c7-bdbc-a1c358b2916c service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-changed-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG nova.compute.manager [req-574c8343-2d61-4bcd-a679-35a82b8009b0 req-7859a802-70f8-40c7-bdbc-a1c358b2916c service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Refreshing instance network info cache due to event network-changed-fba78b12-1ec4-4b48-b972-fabe6eb861cb. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-574c8343-2d61-4bcd-a679-35a82b8009b0 req-7859a802-70f8-40c7-bdbc-a1c358b2916c service nova] Acquiring lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-574c8343-2d61-4bcd-a679-35a82b8009b0 req-7859a802-70f8-40c7-bdbc-a1c358b2916c service nova] Acquired lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG nova.network.neutron [req-574c8343-2d61-4bcd-a679-35a82b8009b0 req-7859a802-70f8-40c7-bdbc-a1c358b2916c service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Refreshing network info cache for port fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Successfully updated port: 9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquired lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG nova.compute.manager [req-da8f5040-b861-4a2a-8423-fa7e5a41121e req-2feee6a7-2e7b-4fe4-a4e4-2cbde90fd61d service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-changed-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG nova.compute.manager [req-da8f5040-b861-4a2a-8423-fa7e5a41121e req-2feee6a7-2e7b-4fe4-a4e4-2cbde90fd61d service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Refreshing instance network info cache due to event network-changed-9a2c0b26-5663-4e79-8f4a-cd712d7cf718. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-da8f5040-b861-4a2a-8423-fa7e5a41121e req-2feee6a7-2e7b-4fe4-a4e4-2cbde90fd61d service nova] Acquiring lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:50:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG nova.objects.instance [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lazy-loading 'flavor' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.123s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG nova.network.neutron [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updating instance_info_cache with network_info: [{"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Releasing lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Instance network_info: |[{"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-da8f5040-b861-4a2a-8423-fa7e5a41121e req-2feee6a7-2e7b-4fe4-a4e4-2cbde90fd61d service nova] Acquired lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG nova.network.neutron [req-da8f5040-b861-4a2a-8423-fa7e5a41121e req-2feee6a7-2e7b-4fe4-a4e4-2cbde90fd61d service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Refreshing network info cache for port 9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:50:42 user nova-compute[75018]: INFO nova.compute.manager [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Attaching volume 365113e0-4b53-4b3e-bf01-57c3634a5101 to /dev/vdb
Nov 07 15:50:42 user nova-compute[75018]: DEBUG nova.network.neutron [req-574c8343-2d61-4bcd-a679-35a82b8009b0 req-7859a802-70f8-40c7-bdbc-a1c358b2916c service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updated VIF entry in instance network info cache for port fba78b12-1ec4-4b48-b972-fabe6eb861cb. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG nova.network.neutron [req-574c8343-2d61-4bcd-a679-35a82b8009b0 req-7859a802-70f8-40c7-bdbc-a1c358b2916c service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updating instance_info_cache with network_info: [{"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-574c8343-2d61-4bcd-a679-35a82b8009b0 req-7859a802-70f8-40c7-bdbc-a1c358b2916c service nova] Releasing lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG os_brick.utils [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d85e514-43e4-467c-ac40-39888e41b31a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1120ab-1d5a-4972-991b-c0b5c1a7f6be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d133cffc-dbfe-4e67-ac44-623f3a08c0ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ffb584-21f7-4609-a9db-5b4b220cb672]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:50:42 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a0270e-ce87-4594-821a-98b4f9cb51bd]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG os_brick.utils [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updating existing volume attachment record: a9bca88f-e8e3-4299-8cbb-0c52369d4086 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG nova.network.neutron [req-da8f5040-b861-4a2a-8423-fa7e5a41121e req-2feee6a7-2e7b-4fe4-a4e4-2cbde90fd61d service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updated VIF entry in instance network info cache for port 9a2c0b26-5663-4e79-8f4a-cd712d7cf718. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG nova.network.neutron [req-da8f5040-b861-4a2a-8423-fa7e5a41121e req-2feee6a7-2e7b-4fe4-a4e4-2cbde90fd61d service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updating instance_info_cache with network_info: [{"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:50:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-da8f5040-b861-4a2a-8423-fa7e5a41121e req-2feee6a7-2e7b-4fe4-a4e4-2cbde90fd61d service nova] Releasing lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:50:43 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:50:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG os_brick.utils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abad294-3139-478e-ab50-6550531ebd78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb8bbdc-28da-43b1-8115-17f4a1db1fc2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dbfd5f-aece-4bb9-b87a-a120ea3d10de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[651dc781-58cb-4848-bcf6-7c3486f57586]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:50:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:50:46 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:50:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2af475-16e6-4d0a-a838-1ffbcaf3e8e9]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:50:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:50:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:50:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:50:46 user nova-compute[75018]: DEBUG os_brick.utils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:50:46 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updating existing volume attachment record: 9ac423d4-2117-471b-ad4b-7dcdde43f8a1 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:50:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:50:46 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:50:46 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:50:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:50:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:50:46 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:50:47 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updating instance_info_cache with network_info: [{"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:50:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-2ffc6cf3-fb96-48b1-9783-6434e107f09e" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:50:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:50:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:50:48 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:50:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:50:52 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:50:53 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:50:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:50:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:50:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:50:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:50:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:50:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:50:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:50:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:50:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:50:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:50:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:50:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:50:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:50:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8591MB free_disk=24.89947509765625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:50:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:50:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:50:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 64559109-6166-488d-a457-20b5f01ddf40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:50:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 2ffc6cf3-fb96-48b1-9783-6434e107f09e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:50:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:50:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:50:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:50:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:50:55 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:50:55 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:50:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:50:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:50:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:51:00 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2ffc6cf3-fb96-48b1-9783-6434e107f09e is timed out.
Nov 07 15:51:00 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Successfully detached device vdb from instance 2ffc6cf3-fb96-48b1-9783-6434e107f09e from the live domain config.
Nov 07 15:51:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:51:00 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhIgDUCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:51:00 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:51:00 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef8b484-bfbc-4f0b-ac7c-ff08cb040706]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:51:01 user nova-compute[75018]: No targets found.
Nov 07 15:51:01 user nova-compute[75018]: iSNS:
Nov 07 15:51:01 user nova-compute[75018]: No targets found.
Nov 07 15:51:01 user nova-compute[75018]: STATIC:
Nov 07 15:51:01 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d
Nov 07 15:51:01 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:51:01 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:51:01 user nova-compute[75018]: FIRMWARE:
Nov 07 15:51:01 user nova-compute[75018]: No targets found.
Nov 07 15:51:01 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:51:01 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:51:01 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[364f4b16-a394-439a-bcad-1cb185949459]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d669cf-1fae-4854-8580-2f28f9a63afb]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:51:01 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d (non-flash)
Nov 07 15:51:01 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae02fe3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9f5759-eb81-45e0-838e-ed3b0e1623f6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9d096c-f81e-45ea-95cf-0d8b3aab3edb]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c940bc6-163b-40a6-884c-43e4cd4b8963]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[09db4751-e45a-4bfb-9426-b451c2a78b46]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c1a7d4-74fb-4881-b851-55b8f6320366]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[618ff26f-84fd-4ba4-9ab3-3b69803d206c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260]
Nov 07 15:51:01 user nova-compute[75018]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d, portal: 172.16.0.220,3260] successful.
Nov 07 15:51:01 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2d0cd3b-6433-4b9b-b293-503fe2f4d43d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cd0960-d307-4643-997b-f850cc30fd50]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] <== disconnect_volume: return (299ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:51:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:51:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:51:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:51:08 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Creating image(s)
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Did not create local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Ensure instance console log exists: /opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Start _get_guest_xml network_info=[{"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JanMNVyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fa037da8-53d1-4dcd-9478-59a9e9cfb726', 'attached_at': '', 'detached_at': '', 'volume_id': 'b14e2e95-1ea1-4a26-8020-9c2b54d69df9', 'serial': 'b14e2e95-1ea1-4a26-8020-9c2b54d69df9'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '9ac423d4-2117-471b-ad4b-7dcdde43f8a1', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:51:08 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:51:08 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JanMNVyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:51:08 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:51:08 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:51:08 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c764eb2e-8784-4a6e-b36f-5adf3d93c194]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:51:08 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66f002d-3c16-419b-af43-60a142ecd0f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9] added
Nov 07 15:51:08 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c92b363-8dd2-4938-973a-4d1497523aef]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d79ec4-dea9-426c-9a33-471d0fc91dd4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JanMNVyI {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JanMNVyI" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f28b538-443b-442e-bd8c-c5ab62591ce2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JanMNVyI'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[19476ade-a0b0-4031-8249-612b2337aadd]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f1e978-9c57-4d90-8418-3599e0595114]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 15:51:08 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 15:51:08 user nova-compute[75018]:  {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:51:08 user nova-compute[75018]: WARNING os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 15:51:08 user nova-compute[75018]: 
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a474b58-57ae-4177-8067-ef376174d23d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9, portal: 172.16.0.220,3260]
Nov 07 15:51:08 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9, portal: 172.16.0.220,3260] successful.
Nov 07 15:51:08 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6292b9-e3a8-47b8-82a2-c9fea63e3f3d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[944cb5dc-dea5-4a3d-8878-d9e1200cc87c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:51:08 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:51:08 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f304e742-b463-4f21-870b-f33afc87b303]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:51:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JanMNVyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23435326163613835', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435326163613835', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-501708816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-501708816',id=44,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b703f914a00c4d5399fbd2a05d855e20',ramdisk_id='',reservation_id='r-zva0adi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:50:40Z,user_data=None,user_id='b85e59486dda47eeb7b0cf5ddf732ecf',uuid=fa037da8-53d1-4dcd-9478-59a9e9cfb726,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converting VIF {"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:62:87,bridge_name='br-int',has_traffic_filtering=True,id=9a2c0b26-5663-4e79-8f4a-cd712d7cf718,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2c0b26-56') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG nova.objects.instance [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'pci_devices' on Instance uuid fa037da8-53d1-4dcd-9478-59a9e9cfb726 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:51:09 user nova-compute[75018]:   <uuid>fa037da8-53d1-4dcd-9478-59a9e9cfb726</uuid>
Nov 07 15:51:09 user nova-compute[75018]:   <name>instance-0000002c</name>
Nov 07 15:51:09 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:51:09 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:51:09 user nova-compute[75018]:   <metadata>
Nov 07 15:51:09 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:51:09 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:51:09 user nova-compute[75018]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-501708816</nova:name>
Nov 07 15:51:09 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:51:08</nova:creationTime>
Nov 07 15:51:09 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:51:09 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:51:09 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:51:09 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:51:09 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:51:09 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:51:09 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:51:09 user nova-compute[75018]:       <nova:owner>
Nov 07 15:51:09 user nova-compute[75018]:         <nova:user uuid="b85e59486dda47eeb7b0cf5ddf732ecf">tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member</nova:user>
Nov 07 15:51:09 user nova-compute[75018]:         <nova:project uuid="b703f914a00c4d5399fbd2a05d855e20">tempest-ServerBootFromVolumeStableRescueTest-1314994176</nova:project>
Nov 07 15:51:09 user nova-compute[75018]:       </nova:owner>
Nov 07 15:51:09 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:51:09 user nova-compute[75018]:       <nova:ports>
Nov 07 15:51:09 user nova-compute[75018]:         <nova:port uuid="9a2c0b26-5663-4e79-8f4a-cd712d7cf718">
Nov 07 15:51:09 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 07 15:51:09 user nova-compute[75018]:         </nova:port>
Nov 07 15:51:09 user nova-compute[75018]:       </nova:ports>
Nov 07 15:51:09 user nova-compute[75018]:     </nova:instance>
Nov 07 15:51:09 user nova-compute[75018]:   </metadata>
Nov 07 15:51:09 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:51:09 user nova-compute[75018]:     <system>
Nov 07 15:51:09 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:51:09 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:51:09 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:51:09 user nova-compute[75018]:       <entry name="serial">fa037da8-53d1-4dcd-9478-59a9e9cfb726</entry>
Nov 07 15:51:09 user nova-compute[75018]:       <entry name="uuid">fa037da8-53d1-4dcd-9478-59a9e9cfb726</entry>
Nov 07 15:51:09 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:51:09 user nova-compute[75018]:     </system>
Nov 07 15:51:09 user nova-compute[75018]:   </sysinfo>
Nov 07 15:51:09 user nova-compute[75018]:   <os>
Nov 07 15:51:09 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:51:09 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:51:09 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:51:09 user nova-compute[75018]:   </os>
Nov 07 15:51:09 user nova-compute[75018]:   <features>
Nov 07 15:51:09 user nova-compute[75018]:     <acpi/>
Nov 07 15:51:09 user nova-compute[75018]:     <apic/>
Nov 07 15:51:09 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:51:09 user nova-compute[75018]:   </features>
Nov 07 15:51:09 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:51:09 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:51:09 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:51:09 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:51:09 user nova-compute[75018]:   </clock>
Nov 07 15:51:09 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:51:09 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:51:09 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:51:09 user nova-compute[75018]:   </cpu>
Nov 07 15:51:09 user nova-compute[75018]:   <devices>
Nov 07 15:51:09 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:51:09 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:51:09 user nova-compute[75018]:       <source dev="/dev/sdb"/>
Nov 07 15:51:09 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:51:09 user nova-compute[75018]:       <serial>b14e2e95-1ea1-4a26-8020-9c2b54d69df9</serial>
Nov 07 15:51:09 user nova-compute[75018]:     </disk>
Nov 07 15:51:09 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:51:09 user nova-compute[75018]:       <mac address="fa:16:3e:25:62:87"/>
Nov 07 15:51:09 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:51:09 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:51:09 user nova-compute[75018]:       <target dev="tap9a2c0b26-56"/>
Nov 07 15:51:09 user nova-compute[75018]:     </interface>
Nov 07 15:51:09 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:51:09 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/console.log" append="off"/>
Nov 07 15:51:09 user nova-compute[75018]:     </serial>
Nov 07 15:51:09 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:51:09 user nova-compute[75018]:     <video>
Nov 07 15:51:09 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:51:09 user nova-compute[75018]:     </video>
Nov 07 15:51:09 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:51:09 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:51:09 user nova-compute[75018]:     </rng>
Nov 07 15:51:09 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:51:09 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:51:09 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:51:09 user nova-compute[75018]:     </memballoon>
Nov 07 15:51:09 user nova-compute[75018]:   </devices>
Nov 07 15:51:09 user nova-compute[75018]: </domain>
Nov 07 15:51:09 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-501708816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-501708816',id=44,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b703f914a00c4d5399fbd2a05d855e20',ramdisk_id='',reservation_id='r-zva0adi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:50:40Z,user_data=None,user_id='b85e59486dda47eeb7b0cf5ddf732ecf',uuid=fa037da8-53d1-4dcd-9478-59a9e9cfb726,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converting VIF {"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:62:87,bridge_name='br-int',has_traffic_filtering=True,id=9a2c0b26-5663-4e79-8f4a-cd712d7cf718,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2c0b26-56') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG os_vif [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:62:87,bridge_name='br-int',has_traffic_filtering=True,id=9a2c0b26-5663-4e79-8f4a-cd712d7cf718,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2c0b26-56') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1d504d9-b49a-5436-84e4-9c334cb48e66', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a2c0b26-56, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a2c0b26-56, col_values=(('qos', UUID('428379d5-9e73-40a6-93c4-2797a717bf4b')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a2c0b26-56, col_values=(('external_ids', {'iface-id': '9a2c0b26-5663-4e79-8f4a-cd712d7cf718', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:62:87', 'vm-uuid': 'fa037da8-53d1-4dcd-9478-59a9e9cfb726'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:09 user nova-compute[75018]: INFO os_vif [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:62:87,bridge_name='br-int',has_traffic_filtering=True,id=9a2c0b26-5663-4e79-8f4a-cd712d7cf718,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2c0b26-56')
Nov 07 15:51:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:51:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] No VIF found with MAC fa:16:3e:25:62:87, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:51:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-ed7a7529-3ca6-4b4f-a6d4-d112ac112233 req-f93c96a5-1bc5-413e-b05f-4b918064e6b8 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:51:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ed7a7529-3ca6-4b4f-a6d4-d112ac112233 req-f93c96a5-1bc5-413e-b05f-4b918064e6b8 service nova] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:51:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ed7a7529-3ca6-4b4f-a6d4-d112ac112233 req-f93c96a5-1bc5-413e-b05f-4b918064e6b8 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:51:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ed7a7529-3ca6-4b4f-a6d4-d112ac112233 req-f93c96a5-1bc5-413e-b05f-4b918064e6b8 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:51:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-ed7a7529-3ca6-4b4f-a6d4-d112ac112233 req-f93c96a5-1bc5-413e-b05f-4b918064e6b8 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] No waiting events found dispatching network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:51:11 user nova-compute[75018]: WARNING nova.compute.manager [req-ed7a7529-3ca6-4b4f-a6d4-d112ac112233 req-f93c96a5-1bc5-413e-b05f-4b918064e6b8 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received unexpected event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 for instance with vm_state building and task_state spawning.
Nov 07 15:51:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-0902447c-b57d-4342-a1ba-8c6b028b9c13 req-a352c1f6-5800-4ce3-9dd3-ce71e0d9dc55 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:51:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0902447c-b57d-4342-a1ba-8c6b028b9c13 req-a352c1f6-5800-4ce3-9dd3-ce71e0d9dc55 service nova] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:51:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0902447c-b57d-4342-a1ba-8c6b028b9c13 req-a352c1f6-5800-4ce3-9dd3-ce71e0d9dc55 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:51:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-0902447c-b57d-4342-a1ba-8c6b028b9c13 req-a352c1f6-5800-4ce3-9dd3-ce71e0d9dc55 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:51:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-0902447c-b57d-4342-a1ba-8c6b028b9c13 req-a352c1f6-5800-4ce3-9dd3-ce71e0d9dc55 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] No waiting events found dispatching network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:51:13 user nova-compute[75018]: WARNING nova.compute.manager [req-0902447c-b57d-4342-a1ba-8c6b028b9c13 req-a352c1f6-5800-4ce3-9dd3-ce71e0d9dc55 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received unexpected event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 for instance with vm_state building and task_state spawning.
Nov 07 15:51:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:51:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:51:13 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Instance spawned successfully.
Nov 07 15:51:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:51:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:51:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:51:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:51:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:51:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:51:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:51:13 user nova-compute[75018]: INFO nova.compute.manager [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 07 15:51:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:51:13 user nova-compute[75018]: INFO nova.compute.manager [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Took 33.97 seconds to build instance.
Nov 07 15:51:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-a77bfa6f-4c9b-4f07-bf75-1df0dfe39d28 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.110s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:51:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG nova.objects.instance [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'flavor' on Instance uuid 2ffc6cf3-fb96-48b1-9783-6434e107f09e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e6024aa6-abef-40a0-9add-acc70845104e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 40.767s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWosDTEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:51:21 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:51:21 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:51:21 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fd4df9-393b-4f30-8b40-66d786093dc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:51:21 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3914714-741b-4355-815b-2c6a911fed09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101] added
Nov 07 15:51:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[21247ea1-8c27-4876-8c22-fff48e377be8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a0a8dc-482e-4862-b980-8660837ca191]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pWosDTEM {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pWosDTEM" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[748bdafa-7d3b-44fd-9178-ccce316bbeb6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pWosDTEM'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bc2513-89f8-44f3-8eae-580d88409eb9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6aa0b17-20e2-444d-bb91-d4772fda1bdd]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:51:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:51:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c7998b-95b3-4f5b-b3e5-7f4614523fb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101, portal: 172.16.0.220,3260]
Nov 07 15:51:21 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101, portal: 172.16.0.220,3260] successful.
Nov 07 15:51:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7ecc74-7e5d-4b13-9849-acb65b5d2e78]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e83601-3581-44fb-a3d5-ca036ee7b7f7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:51:21 user nova-compute[75018]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 (non-flash)
Nov 07 15:51:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:51:21 user nova-compute[75018]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 (non-flash)
Nov 07 15:51:21 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9268e3-3720-4e44-9d97-c48b1ee416f3]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:51:21 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWosDTEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:51:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:51:22 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23631666538643931', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:51:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631666538643931', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:51:22 user nova-compute[75018]: DEBUG nova.objects.instance [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lazy-loading 'flavor' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:51:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:51:22 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:51:22 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:51:22 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:51:22 user nova-compute[75018]:   <serial>365113e0-4b53-4b3e-bf01-57c3634a5101</serial>
Nov 07 15:51:22 user nova-compute[75018]: </disk>
Nov 07 15:51:22 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:51:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:51:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:51:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] No VIF found with MAC fa:16:3e:9a:04:46, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:51:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-69569b9a-4fe3-496a-bc3f-ebdf2c81bec1 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.686s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:51:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:51:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:51:24 user nova-compute[75018]: INFO nova.compute.manager [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Detaching volume 365113e0-4b53-4b3e-bf01-57c3634a5101
Nov 07 15:51:24 user nova-compute[75018]: INFO nova.virt.block_device [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Attempting to driver detach volume 365113e0-4b53-4b3e-bf01-57c3634a5101 from mountpoint /dev/vdb
Nov 07 15:51:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Attempting to detach device vdb from instance 64559109-6166-488d-a457-20b5f01ddf40 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:51:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:51:24 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:51:24 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:51:24 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:51:24 user nova-compute[75018]:   <serial>365113e0-4b53-4b3e-bf01-57c3634a5101</serial>
Nov 07 15:51:24 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:51:24 user nova-compute[75018]: </disk>
Nov 07 15:51:24 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:51:24 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Successfully detached device vdb from instance 64559109-6166-488d-a457-20b5f01ddf40 from the persistent domain config.
Nov 07 15:51:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64559109-6166-488d-a457-20b5f01ddf40 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:51:24 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:51:24 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:51:24 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:51:24 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:51:24 user nova-compute[75018]:   <serial>365113e0-4b53-4b3e-bf01-57c3634a5101</serial>
Nov 07 15:51:24 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:51:24 user nova-compute[75018]: </disk>
Nov 07 15:51:24 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:51:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:51:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:51:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:36 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:51:36 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:51:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 15:51:36 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] There are 0 instances to clean {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 15:51:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:51:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:51:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:51:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:51:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:40 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:51:41 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:51:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:51:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:51:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:51:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:51:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:51:42 user nova-compute[75018]: INFO nova.compute.manager [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Terminating instance
Nov 07 15:51:42 user nova-compute[75018]: DEBUG nova.compute.manager [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:51:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-4c2b0406-3273-4805-b355-560e78a507e7 req-bf9c4a21-d8e0-4f53-b205-2f5b42722171 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-vif-unplugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4c2b0406-3273-4805-b355-560e78a507e7 req-bf9c4a21-d8e0-4f53-b205-2f5b42722171 service nova] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4c2b0406-3273-4805-b355-560e78a507e7 req-bf9c4a21-d8e0-4f53-b205-2f5b42722171 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-4c2b0406-3273-4805-b355-560e78a507e7 req-bf9c4a21-d8e0-4f53-b205-2f5b42722171 service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-4c2b0406-3273-4805-b355-560e78a507e7 req-bf9c4a21-d8e0-4f53-b205-2f5b42722171 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] No waiting events found dispatching network-vif-unplugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-4c2b0406-3273-4805-b355-560e78a507e7 req-bf9c4a21-d8e0-4f53-b205-2f5b42722171 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-vif-unplugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:43 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Instance destroyed successfully.
Nov 07 15:51:43 user nova-compute[75018]: DEBUG nova.objects.instance [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'resources' on Instance uuid 2ffc6cf3-fb96-48b1-9783-6434e107f09e {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2007259099',display_name='tempest-TestMinimumBasicScenario-server-2007259099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2007259099',id=41,image_ref='cb5b3cf6-9c69-4273-8104-16e4fb6c2f16',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5HG2OdhSPmgIIlNgxbkQ96mEDjXH0cLhbCGyYUW1ZSJYR9IWY1NlFSNWNSR94SssE5COVhVs4rfpnjk/C8eZPku/sBzb/THjU+EqbM57rp2A+oFnjHZA4xyojEOlC9Cw==',key_name='tempest-TestMinimumBasicScenario-1546028479',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:45:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e9055a2f9df4fc1867db5de885f5430',ramdisk_id='',reservation_id='r-ysspxro3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb5b3cf6-9c69-4273-8104-16e4fb6c2f16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-376924718',owner_user_name='tempest-TestMinimumBasicScenario-376924718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:48:56Z,user_data=None,user_id='d4927e184ba449c493a60d9580755235',uuid=2ffc6cf3-fb96-48b1-9783-6434e107f09e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converting VIF {"id": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "address": "fa:16:3e:e3:3f:4c", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba78b12-1e", "ovs_interfaceid": "fba78b12-1ec4-4b48-b972-fabe6eb861cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3f:4c,bridge_name='br-int',has_traffic_filtering=True,id=fba78b12-1ec4-4b48-b972-fabe6eb861cb,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba78b12-1e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG os_vif [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3f:4c,bridge_name='br-int',has_traffic_filtering=True,id=fba78b12-1ec4-4b48-b972-fabe6eb861cb,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba78b12-1e') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfba78b12-1e, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a61d3d1-25f9-48c7-a226-30c6b2a34a18) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:51:43 user nova-compute[75018]: INFO os_vif [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3f:4c,bridge_name='br-int',has_traffic_filtering=True,id=fba78b12-1ec4-4b48-b972-fabe6eb861cb,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba78b12-1e')
Nov 07 15:51:43 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Deleting instance files /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e_del
Nov 07 15:51:43 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Deletion of /opt/stack/data/nova/instances/2ffc6cf3-fb96-48b1-9783-6434e107f09e_del complete
Nov 07 15:51:43 user nova-compute[75018]: INFO nova.compute.manager [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 07 15:51:43 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:51:43 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:51:44 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:51:44 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Took 0.47 seconds to deallocate network for instance.
Nov 07 15:51:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-ff93d98e-f3b6-49b6-91f9-ac404be16d5f req-71bb0ea0-48ce-4240-bffe-ef0eb4155196 service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-vif-deleted-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:51:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:51:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:51:44 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:51:44 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:51:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:51:44 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Deleted allocations for instance 2ffc6cf3-fb96-48b1-9783-6434e107f09e
Nov 07 15:51:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-bc296545-4a08-455a-b6c0-e0a7afd110f6 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.791s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:51:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:51:44 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-3ee335d3-da8a-4954-a422-391279f9ca4a req-b1a14f7a-d3d7-4a93-9ff5-23966906ec1c service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3ee335d3-da8a-4954-a422-391279f9ca4a req-b1a14f7a-d3d7-4a93-9ff5-23966906ec1c service nova] Acquiring lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3ee335d3-da8a-4954-a422-391279f9ca4a req-b1a14f7a-d3d7-4a93-9ff5-23966906ec1c service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3ee335d3-da8a-4954-a422-391279f9ca4a req-b1a14f7a-d3d7-4a93-9ff5-23966906ec1c service nova] Lock "2ffc6cf3-fb96-48b1-9783-6434e107f09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-3ee335d3-da8a-4954-a422-391279f9ca4a req-b1a14f7a-d3d7-4a93-9ff5-23966906ec1c service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] No waiting events found dispatching network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:51:45 user nova-compute[75018]: WARNING nova.compute.manager [req-3ee335d3-da8a-4954-a422-391279f9ca4a req-b1a14f7a-d3d7-4a93-9ff5-23966906ec1c service nova] [instance: 2ffc6cf3-fb96-48b1-9783-6434e107f09e] Received unexpected event network-vif-plugged-fba78b12-1ec4-4b48-b972-fabe6eb861cb for instance with vm_state deleted and task_state None.
Nov 07 15:51:45 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 64559109-6166-488d-a457-20b5f01ddf40 is timed out.
Nov 07 15:51:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Successfully detached device vdb from instance 64559109-6166-488d-a457-20b5f01ddf40 from the live domain config.
Nov 07 15:51:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWosDTEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:51:45 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceecbc57-160c-4cf2-9c82-f71a16a9fab9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:51:45 user nova-compute[75018]: No targets found.
Nov 07 15:51:45 user nova-compute[75018]: iSNS:
Nov 07 15:51:45 user nova-compute[75018]: No targets found.
Nov 07 15:51:45 user nova-compute[75018]: STATIC:
Nov 07 15:51:45 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9
Nov 07 15:51:45 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:51:45 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:51:45 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101
Nov 07 15:51:45 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:51:45 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:51:45 user nova-compute[75018]: FIRMWARE:
Nov 07 15:51:45 user nova-compute[75018]: No targets found.
Nov 07 15:51:45 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:51:45 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:51:45 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2da3116-418d-4b0c-a532-99e8ec3f0fcc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd694eac-f3b8-453b-b784-16f2180b93ca]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:51:45 user nova-compute[75018]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 (non-flash)
Nov 07 15:51:45 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:51:45 user nova-compute[75018]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 (non-flash)
Nov 07 15:51:45 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae02b6d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101'): ({'sdc'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Removing single pathed devices sdc {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a16049-3ac3-45f7-8eab-b843bd64110f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a348f1-b40c-403c-894a-41f2a69e99f4]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Flushing IO for device /dev/sdc {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5c00e1-1297-4b45-af4c-bb1819a82349]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67fdf1e-eb3f-4d02-8469-c93024d641a6]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[305aef06-d93f-473a-b533-bd089a5ade8d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3b83f9-aeb5-4bb0-b0df-ca603c0be1e0]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101, portal: 172.16.0.220,3260]
Nov 07 15:51:45 user nova-compute[75018]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101, portal: 172.16.0.220,3260] successful.
Nov 07 15:51:45 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365113e0-4b53-4b3e-bf01-57c3634a5101 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[870e0f1b-8eb4-4b83-a373-f50e99354581]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] <== disconnect_volume: return (317ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:51:45 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:51:46 user nova-compute[75018]: DEBUG nova.objects.instance [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lazy-loading 'flavor' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:51:46 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-81efa547-7f09-4d4a-8281-1023424bc04b tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.794s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:51:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:51:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:51:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:51:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:51:47 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:51:48 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updating instance_info_cache with network_info: [{"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:51:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:51:48 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:51:48 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:51:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:51:49 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:51:50 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:51:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75018) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 15:51:53 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:51:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:51:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:51:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:51:53 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:51:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:51:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:51:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:53 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:51:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:51:54 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:51:54 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:51:54 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8681MB free_disk=24.916481018066406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:51:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:51:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 64559109-6166-488d-a457-20b5f01ddf40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing inventories for resource provider 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating ProviderTree inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing aggregate associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, aggregates: None {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing trait associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:51:55 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:51:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:52:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:52:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:52:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:52:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:52:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:52:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:52:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:52:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:52:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lazy-loading 'flavor' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:25 user nova-compute[75018]: INFO nova.compute.manager [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Attaching volume 0d85b079-dddc-4457-818b-6074a150354d to /dev/vdb
Nov 07 15:52:25 user nova-compute[75018]: DEBUG os_brick.utils [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f95cee-122a-4ec3-a1e7-5d666cf90bb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b20dce2-3490-4512-b008-1db93f35e291]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[511528f5-fdcc-4819-92a9-f9779ae96f92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9875e45-ad67-4862-a49c-cf83a50fb3d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:52:25 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:52:25 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[91334e74-0ff9-4b5c-ad50-d343f9db0433]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG os_brick.utils [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:52:25 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updating existing volume attachment record: 2bb6da84-5d25-40c4-9c5b-5477e88ca1c3 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:52:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:30 user nova-compute[75018]: INFO nova.compute.manager [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Rescuing
Nov 07 15:52:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:52:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquired lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:52:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:52:30 user nova-compute[75018]: DEBUG nova.network.neutron [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updating instance_info_cache with network_info: [{"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:52:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Releasing lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:52:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-fac4106c-fdfc-434c-825a-cf36c0c200a5 req-3e1babf3-39c5-49e1-8f7d-891abbdfea95 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-vif-unplugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:52:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fac4106c-fdfc-434c-825a-cf36c0c200a5 req-3e1babf3-39c5-49e1-8f7d-891abbdfea95 service nova] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fac4106c-fdfc-434c-825a-cf36c0c200a5 req-3e1babf3-39c5-49e1-8f7d-891abbdfea95 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fac4106c-fdfc-434c-825a-cf36c0c200a5 req-3e1babf3-39c5-49e1-8f7d-891abbdfea95 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-fac4106c-fdfc-434c-825a-cf36c0c200a5 req-3e1babf3-39c5-49e1-8f7d-891abbdfea95 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] No waiting events found dispatching network-vif-unplugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:52:30 user nova-compute[75018]: WARNING nova.compute.manager [req-fac4106c-fdfc-434c-825a-cf36c0c200a5 req-3e1babf3-39c5-49e1-8f7d-891abbdfea95 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received unexpected event network-vif-unplugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 for instance with vm_state active and task_state rescuing.
Nov 07 15:52:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:31 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Instance destroyed successfully.
Nov 07 15:52:31 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Attempting a stable device rescue
Nov 07 15:52:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75018) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 07 15:52:31 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Instance directory exists: not creating {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 15:52:31 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Creating image(s)
Nov 07 15:52:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "/opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "/opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:31 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'trusted_certs' on Instance uuid fa037da8-53d1-4dcd-9478-59a9e9cfb726 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:52:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "d9c4d30e262b29368a14231355256c5e4c161728" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "d9c4d30e262b29368a14231355256c5e4c161728" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728.part --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:32 user nova-compute[75018]: DEBUG nova.virt.images [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] 214dc2e6-6381-4965-a846-a9c65ebe26c4 was qcow2, converting to raw {{(pid=75018) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 15:52:32 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:52:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728.part /opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728.converted {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-6774b733-e1b5-4953-a07a-cf34954dc5ee req-e336ebff-a5f6-41b2-9837-652e687ecf75 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6774b733-e1b5-4953-a07a-cf34954dc5ee req-e336ebff-a5f6-41b2-9837-652e687ecf75 service nova] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6774b733-e1b5-4953-a07a-cf34954dc5ee req-e336ebff-a5f6-41b2-9837-652e687ecf75 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6774b733-e1b5-4953-a07a-cf34954dc5ee req-e336ebff-a5f6-41b2-9837-652e687ecf75 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG nova.compute.manager [req-6774b733-e1b5-4953-a07a-cf34954dc5ee req-e336ebff-a5f6-41b2-9837-652e687ecf75 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] No waiting events found dispatching network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:52:33 user nova-compute[75018]: WARNING nova.compute.manager [req-6774b733-e1b5-4953-a07a-cf34954dc5ee req-e336ebff-a5f6-41b2-9837-652e687ecf75 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received unexpected event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 for instance with vm_state active and task_state rescuing.
Nov 07 15:52:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728.part /opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728.converted" returned: 0 in 0.681s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728.converted --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "d9c4d30e262b29368a14231355256c5e4c161728" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.141s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "d9c4d30e262b29368a14231355256c5e4c161728" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "d9c4d30e262b29368a14231355256c5e4c161728" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728 --force-share --output=json" returned: 0 in 0.189s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728,backing_fmt=raw /opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/disk.rescue {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728,backing_fmt=raw /opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/disk.rescue" returned: 0 in 0.051s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "d9c4d30e262b29368a14231355256c5e4c161728" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'migration_context' on Instance uuid fa037da8-53d1-4dcd-9478-59a9e9cfb726 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG nova.objects.base [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Object Instance<fa037da8-53d1-4dcd-9478-59a9e9cfb726> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Start _get_guest_xml network_info=[{"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "vif_mac": "fa:16:3e:25:62:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '214dc2e6-6381-4965-a846-a9c65ebe26c4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JanMNVyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'fa037da8-53d1-4dcd-9478-59a9e9cfb726', 'attached_at': '', 'detached_at': '', 'volume_id': 'b14e2e95-1ea1-4a26-8020-9c2b54d69df9', 'serial': 'b14e2e95-1ea1-4a26-8020-9c2b54d69df9'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '9ac423d4-2117-471b-ad4b-7dcdde43f8a1', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:52:33 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'resources' on Instance uuid fa037da8-53d1-4dcd-9478-59a9e9cfb726 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.objects.base [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Object Instance<fa037da8-53d1-4dcd-9478-59a9e9cfb726> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'numa_topology' on Instance uuid fa037da8-53d1-4dcd-9478-59a9e9cfb726 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.objects.base [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Object Instance<fa037da8-53d1-4dcd-9478-59a9e9cfb726> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:52:34 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:52:34 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa037da8-53d1-4dcd-9478-59a9e9cfb726 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.objects.base [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Object Instance<fa037da8-53d1-4dcd-9478-59a9e9cfb726> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JanMNVyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:52:34 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:52:34 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:52:34 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[889668d8-059e-4d0b-82ef-6a1307e61e6c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JanMNVyI\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 07 15:52:34 user nova-compute[75018]: node.name = iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9
Nov 07 15:52:34 user nova-compute[75018]: node.tpgt = -1
Nov 07 15:52:34 user nova-compute[75018]: node.startup = automatic
Nov 07 15:52:34 user nova-compute[75018]: node.leading_login = No
Nov 07 15:52:34 user nova-compute[75018]: iface.iscsi_ifacename = default
Nov 07 15:52:34 user nova-compute[75018]: iface.net_ifacename = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.ipaddress = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.prefix_len = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.hwaddress = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.transport_name = tcp
Nov 07 15:52:34 user nova-compute[75018]: iface.initiatorname = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.state = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.vlan_id = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.vlan_priority = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.vlan_state = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.iface_num = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.mtu = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.port = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.bootproto = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.subnet_mask = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.gateway = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.dhcp_alt_client_id_state = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.dhcp_alt_client_id = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.dhcp_dns = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.dhcp_learn_iqn = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.dhcp_req_vendor_id_state = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.dhcp_vendor_id_state = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.dhcp_vendor_id = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.dhcp_slp_da = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.fragmentation = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.gratuitous_arp = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.incoming_forwarding = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.tos_state = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.tos = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.ttl = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.delayed_ack = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.tcp_nagle = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.tcp_wsf_state = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.tcp_wsf = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.tcp_timer_scale = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.tcp_timestamp = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.redirect = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.def_task_mgmt_timeout = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.header_digest = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.data_digest = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.immediate_data = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.initial_r2t = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.data_seq_inorder = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.data_pdu_inorder = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.erl = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.max_receive_data_len = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.first_burst_len = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.max_outstanding_r2t = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.max_burst_len = 0
Nov 07 15:52:34 user nova-compute[75018]: iface.chap_auth = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.bidi_chap = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.strict_login_compliance = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.discovery_auth = <empty>
Nov 07 15:52:34 user nova-compute[75018]: iface.discovery_logout = <empty>
Nov 07 15:52:34 user nova-compute[75018]: node.discovery_address = <empty>
Nov 07 15:52:34 user nova-compute[75018]: node.discovery_port = 0
Nov 07 15:52:34 user nova-compute[75018]: node.discovery_type = static
Nov 07 15:52:34 user nova-compute[75018]: node.session.initial_cmdsn = 0
Nov 07 15:52:34 user nova-compute[75018]: node.session.initial_login_retry_max = 8
Nov 07 15:52:34 user nova-compute[75018]: node.session.xmit_thread_priority = -20
Nov 07 15:52:34 user nova-compute[75018]: node.session.cmds_max = 128
Nov 07 15:52:34 user nova-compute[75018]: node.session.queue_depth = 32
Nov 07 15:52:34 user nova-compute[75018]: node.session.nr_sessions = 1
Nov 07 15:52:34 user nova-compute[75018]: node.session.auth.authmethod = CHAP
Nov 07 15:52:34 user nova-compute[75018]: node.session.auth.username = JanMNVyI
Nov 07 15:52:34 user nova-compute[75018]: node.session.auth.password = ***
Nov 07 15:52:34 user nova-compute[75018]: node.session.auth.username_in = <empty>
Nov 07 15:52:34 user nova-compute[75018]: node.session.auth.password_in = <empty>
Nov 07 15:52:34 user nova-compute[75018]: node.session.auth.chap_algs = MD5
Nov 07 15:52:34 user nova-compute[75018]: node.session.timeo.replacement_timeout = 120
Nov 07 15:52:34 user nova-compute[75018]: node.session.err_timeo.abort_timeout = 15
Nov 07 15:52:34 user nova-compute[75018]: node.session.err_timeo.lu_reset_timeout = 30
Nov 07 15:52:34 user nova-compute[75018]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 07 15:52:34 user nova-compute[75018]: node.session.err_timeo.host_reset_timeout = 60
Nov 07 15:52:34 user nova-compute[75018]: node.session.iscsi.FastAbort = Yes
Nov 07 15:52:34 user nova-compute[75018]: node.session.iscsi.InitialR2T = No
Nov 07 15:52:34 user nova-compute[75018]: node.session.iscsi.ImmediateData = Yes
Nov 07 15:52:34 user nova-compute[75018]: node.session.iscsi.FirstBurstLength = 262144
Nov 07 15:52:34 user nova-compute[75018]: node.session.iscsi.MaxBurstLength = 16776192
Nov 07 15:52:34 user nova-compute[75018]: node.session.iscsi.DefaultTime2Retain = 0
Nov 07 15:52:34 user nova-compute[75018]: node.session.iscsi.DefaultTime2Wait = 2
Nov 07 15:52:34 user nova-compute[75018]: node.session.iscsi.MaxConnections = 1
Nov 07 15:52:34 user nova-compute[75018]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 07 15:52:34 user nova-compute[75018]: node.session.iscsi.ERL = 0
Nov 07 15:52:34 user nova-compute[75018]: node.session.scan = manual
Nov 07 15:52:34 user nova-compute[75018]: node.session.reopen_max = 0
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].address = 172.16.0.220
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].port = 3260
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].startup = manual
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].tcp.window_size = 524288
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].tcp.type_of_service = 0
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].timeo.logout_timeout = 15
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].timeo.login_timeout = 15
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].timeo.auth_timeout = 45
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].timeo.noop_out_interval = 5
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].timeo.noop_out_timeout = 5
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].iscsi.HeaderDigest = None
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].iscsi.DataDigest = None
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].iscsi.IFMarker = No
Nov 07 15:52:34 user nova-compute[75018]: node.conn[0].iscsi.OFMarker = No
Nov 07 15:52:34 user nova-compute[75018]: # END RECORD
Nov 07 15:52:34 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6df229-ad8e-48df-ba15-599fd0a5492c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6a547d-e3a0-4f22-b3f6-9860ba088990]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JanMNVyI {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JanMNVyI" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9ac501-bc12-4736-aab0-f9c00ccd8fc9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JanMNVyI'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f8be6f-465a-4248-ad74-93b72014fbed]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9f49a9-f274-441b-84e1-35bc6dcdaf7a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:52:34 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:52:34 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.169s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] HCTL ('33', '0', '0', 0) found on session 51 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f344d51c-d40b-43a0-8655-57f4dda3e483]: (4, ('0 0 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching for a device in session 51 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JanMNVyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.194s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '23435326163613835', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435326163613835', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-501708816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-501708816',id=44,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:51:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b703f914a00c4d5399fbd2a05d855e20',ramdisk_id='',reservation_id='r-zva0adi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:51:14Z,user_data=None,user_id='b85e59486dda47eeb7b0cf5ddf732ecf',uuid=fa037da8-53d1-4dcd-9478-59a9e9cfb726,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "vif_mac": "fa:16:3e:25:62:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converting VIF {"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "vif_mac": "fa:16:3e:25:62:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:62:87,bridge_name='br-int',has_traffic_filtering=True,id=9a2c0b26-5663-4e79-8f4a-cd712d7cf718,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2c0b26-56') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'pci_devices' on Instance uuid fa037da8-53d1-4dcd-9478-59a9e9cfb726 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.objects.base [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Object Instance<fa037da8-53d1-4dcd-9478-59a9e9cfb726> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:52:34 user nova-compute[75018]:   <uuid>fa037da8-53d1-4dcd-9478-59a9e9cfb726</uuid>
Nov 07 15:52:34 user nova-compute[75018]:   <name>instance-0000002c</name>
Nov 07 15:52:34 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:52:34 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:52:34 user nova-compute[75018]:   <metadata>
Nov 07 15:52:34 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:52:34 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:52:34 user nova-compute[75018]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-501708816</nova:name>
Nov 07 15:52:34 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:52:34</nova:creationTime>
Nov 07 15:52:34 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:52:34 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:52:34 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:52:34 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:52:34 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:52:34 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:52:34 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:52:34 user nova-compute[75018]:       <nova:owner>
Nov 07 15:52:34 user nova-compute[75018]:         <nova:user uuid="b85e59486dda47eeb7b0cf5ddf732ecf">tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member</nova:user>
Nov 07 15:52:34 user nova-compute[75018]:         <nova:project uuid="b703f914a00c4d5399fbd2a05d855e20">tempest-ServerBootFromVolumeStableRescueTest-1314994176</nova:project>
Nov 07 15:52:34 user nova-compute[75018]:       </nova:owner>
Nov 07 15:52:34 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:52:34 user nova-compute[75018]:       <nova:ports>
Nov 07 15:52:34 user nova-compute[75018]:         <nova:port uuid="9a2c0b26-5663-4e79-8f4a-cd712d7cf718">
Nov 07 15:52:34 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 07 15:52:34 user nova-compute[75018]:         </nova:port>
Nov 07 15:52:34 user nova-compute[75018]:       </nova:ports>
Nov 07 15:52:34 user nova-compute[75018]:     </nova:instance>
Nov 07 15:52:34 user nova-compute[75018]:   </metadata>
Nov 07 15:52:34 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:52:34 user nova-compute[75018]:     <system>
Nov 07 15:52:34 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:52:34 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:52:34 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:52:34 user nova-compute[75018]:       <entry name="serial">fa037da8-53d1-4dcd-9478-59a9e9cfb726</entry>
Nov 07 15:52:34 user nova-compute[75018]:       <entry name="uuid">fa037da8-53d1-4dcd-9478-59a9e9cfb726</entry>
Nov 07 15:52:34 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:52:34 user nova-compute[75018]:     </system>
Nov 07 15:52:34 user nova-compute[75018]:   </sysinfo>
Nov 07 15:52:34 user nova-compute[75018]:   <os>
Nov 07 15:52:34 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:52:34 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:52:34 user nova-compute[75018]:   </os>
Nov 07 15:52:34 user nova-compute[75018]:   <features>
Nov 07 15:52:34 user nova-compute[75018]:     <acpi/>
Nov 07 15:52:34 user nova-compute[75018]:     <apic/>
Nov 07 15:52:34 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:52:34 user nova-compute[75018]:   </features>
Nov 07 15:52:34 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:52:34 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:52:34 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:52:34 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:52:34 user nova-compute[75018]:   </clock>
Nov 07 15:52:34 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:52:34 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:52:34 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:52:34 user nova-compute[75018]:   </cpu>
Nov 07 15:52:34 user nova-compute[75018]:   <devices>
Nov 07 15:52:34 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 15:52:34 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:52:34 user nova-compute[75018]:       <source dev="/dev/sdb"/>
Nov 07 15:52:34 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:52:34 user nova-compute[75018]:       <serial>b14e2e95-1ea1-4a26-8020-9c2b54d69df9</serial>
Nov 07 15:52:34 user nova-compute[75018]:     </disk>
Nov 07 15:52:34 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:52:34 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:52:34 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/disk.rescue"/>
Nov 07 15:52:34 user nova-compute[75018]:       <target dev="vdb" bus="virtio"/>
Nov 07 15:52:34 user nova-compute[75018]:       <boot order="1"/>
Nov 07 15:52:34 user nova-compute[75018]:     </disk>
Nov 07 15:52:34 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:52:34 user nova-compute[75018]:       <mac address="fa:16:3e:25:62:87"/>
Nov 07 15:52:34 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:52:34 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:52:34 user nova-compute[75018]:       <target dev="tap9a2c0b26-56"/>
Nov 07 15:52:34 user nova-compute[75018]:     </interface>
Nov 07 15:52:34 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:52:34 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/console.log" append="off"/>
Nov 07 15:52:34 user nova-compute[75018]:     </serial>
Nov 07 15:52:34 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:52:34 user nova-compute[75018]:     <video>
Nov 07 15:52:34 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:52:34 user nova-compute[75018]:     </video>
Nov 07 15:52:34 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:52:34 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:52:34 user nova-compute[75018]:     </rng>
Nov 07 15:52:34 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:52:34 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:52:34 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:52:34 user nova-compute[75018]:     </memballoon>
Nov 07 15:52:34 user nova-compute[75018]:   </devices>
Nov 07 15:52:34 user nova-compute[75018]: </domain>
Nov 07 15:52:34 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:52:34 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Instance destroyed successfully.
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:52:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] No VIF found with MAC fa:16:3e:25:62:87, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:52:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-47b94048-4a6c-461c-a0a2-081c465f0350 req-42ec4709-f6ac-46e7-8061-e89dbcd27c05 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:52:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-47b94048-4a6c-461c-a0a2-081c465f0350 req-42ec4709-f6ac-46e7-8061-e89dbcd27c05 service nova] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-47b94048-4a6c-461c-a0a2-081c465f0350 req-42ec4709-f6ac-46e7-8061-e89dbcd27c05 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-47b94048-4a6c-461c-a0a2-081c465f0350 req-42ec4709-f6ac-46e7-8061-e89dbcd27c05 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-47b94048-4a6c-461c-a0a2-081c465f0350 req-42ec4709-f6ac-46e7-8061-e89dbcd27c05 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] No waiting events found dispatching network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:52:36 user nova-compute[75018]: WARNING nova.compute.manager [req-47b94048-4a6c-461c-a0a2-081c465f0350 req-42ec4709-f6ac-46e7-8061-e89dbcd27c05 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received unexpected event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 for instance with vm_state active and task_state rescuing.
Nov 07 15:52:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:37 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:52:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:37 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:52:37 user nova-compute[75018]: INFO nova.compute.claims [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Claim successful on node user
Nov 07 15:52:38 user nova-compute[75018]: DEBUG nova.compute.manager [req-63f03422-e638-46c9-8212-034a36251084 req-50804bd7-1e0e-4b5d-bec4-135a3c56cff6 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-63f03422-e638-46c9-8212-034a36251084 req-50804bd7-1e0e-4b5d-bec4-135a3c56cff6 service nova] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-63f03422-e638-46c9-8212-034a36251084 req-50804bd7-1e0e-4b5d-bec4-135a3c56cff6 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-63f03422-e638-46c9-8212-034a36251084 req-50804bd7-1e0e-4b5d-bec4-135a3c56cff6 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG nova.compute.manager [req-63f03422-e638-46c9-8212-034a36251084 req-50804bd7-1e0e-4b5d-bec4-135a3c56cff6 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] No waiting events found dispatching network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:52:38 user nova-compute[75018]: WARNING nova.compute.manager [req-63f03422-e638-46c9-8212-034a36251084 req-50804bd7-1e0e-4b5d-bec4-135a3c56cff6 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received unexpected event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 for instance with vm_state active and task_state rescuing.
Nov 07 15:52:38 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:52:38 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:52:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ad03757b-3283-4e81-bc88-ecb1bcfdbfdb tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG nova.policy [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4927e184ba449c493a60d9580755235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9055a2f9df4fc1867db5de885f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:52:38 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Creating image(s)
Nov 07 15:52:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "/opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "/opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "7f8b25bbcd05154251d97577f3daf041a3836237" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "7f8b25bbcd05154251d97577f3daf041a3836237" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237.part --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Successfully created port: 1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:52:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237.part --force-share --output=json" returned: 0 in 0.206s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG nova.virt.images [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] 5dd33011-f3aa-4c13-9516-b9d204cf2acd was qcow2, converting to raw {{(pid=75018) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237.part /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237.converted {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237.part /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237.converted" returned: 0 in 0.240s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237.converted --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "7f8b25bbcd05154251d97577f3daf041a3836237" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.170s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Successfully updated port: 1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237 --force-share --output=json" returned: 0 in 0.204s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "7f8b25bbcd05154251d97577f3daf041a3836237" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "7f8b25bbcd05154251d97577f3daf041a3836237" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquired lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-5849a5a0-e3d1-48a0-8c95-b330d2fab9ff req-8bc2c2c2-2441-4485-84f9-8b8eae6f3786 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-changed-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG nova.compute.manager [req-5849a5a0-e3d1-48a0-8c95-b330d2fab9ff req-8bc2c2c2-2441-4485-84f9-8b8eae6f3786 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Refreshing instance network info cache due to event network-changed-1076a216-6e7e-4f2f-b36e-ecb712d3a509. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5849a5a0-e3d1-48a0-8c95-b330d2fab9ff req-8bc2c2c2-2441-4485-84f9-8b8eae6f3786 service nova] Acquiring lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:52:39 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237 --force-share --output=json" returned: 0 in 0.264s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237,backing_fmt=raw /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237,backing_fmt=raw /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk 1073741824" returned: 0 in 0.049s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "7f8b25bbcd05154251d97577f3daf041a3836237" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.network.neutron [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updating instance_info_cache with network_info: [{"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Releasing lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Instance network_info: |[{"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5849a5a0-e3d1-48a0-8c95-b330d2fab9ff req-8bc2c2c2-2441-4485-84f9-8b8eae6f3786 service nova] Acquired lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.network.neutron [req-5849a5a0-e3d1-48a0-8c95-b330d2fab9ff req-8bc2c2c2-2441-4485-84f9-8b8eae6f3786 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Refreshing network info cache for port 1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237 --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Cannot resize image /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Ensure instance console log exists: /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Start _get_guest_xml network_info=[{"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:52:34Z,direct_url=<?>,disk_format='qcow2',id=5dd33011-f3aa-4c13-9516-b9d204cf2acd,min_disk=0,min_ram=0,name='tempest-scenario-img--371665037',owner='1e9055a2f9df4fc1867db5de885f5430',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:52:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '5dd33011-f3aa-4c13-9516-b9d204cf2acd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:52:40 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:52:40 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:52:34Z,direct_url=<?>,disk_format='qcow2',id=5dd33011-f3aa-4c13-9516-b9d204cf2acd,min_disk=0,min_ram=0,name='tempest-scenario-img--371665037',owner='1e9055a2f9df4fc1867db5de885f5430',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:52:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-48748734',display_name='tempest-TestMinimumBasicScenario-server-48748734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-48748734',id=45,image_ref='5dd33011-f3aa-4c13-9516-b9d204cf2acd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM177KbzSVqGPmKKMaocBIZVFMcB2d/EMs3wCzIH8khblWthttN7YIW70SV3K2uPu0EX4yIysKf7pqxmjwJ29uf8BmH8FLUN9E7rnlPitRt0R8o2SSOky//CBy8kCmrawA==',key_name='tempest-TestMinimumBasicScenario-556187429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e9055a2f9df4fc1867db5de885f5430',ramdisk_id='',reservation_id='r-9kwn2qyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5dd33011-f3aa-4c13-9516-b9d204cf2acd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-376924718',owner_user_name='tempest-TestMinimumBasicScenario-376924718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:52:38Z,user_data=None,user_id='d4927e184ba449c493a60d9580755235',uuid=bd1bd30b-90d6-4625-b47f-b84441f9fb26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converting VIF {"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:da:57,bridge_name='br-int',has_traffic_filtering=True,id=1076a216-6e7e-4f2f-b36e-ecb712d3a509,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1076a216-6e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.objects.instance [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'pci_devices' on Instance uuid bd1bd30b-90d6-4625-b47f-b84441f9fb26 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:52:40 user nova-compute[75018]:   <uuid>bd1bd30b-90d6-4625-b47f-b84441f9fb26</uuid>
Nov 07 15:52:40 user nova-compute[75018]:   <name>instance-0000002d</name>
Nov 07 15:52:40 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:52:40 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:52:40 user nova-compute[75018]:   <metadata>
Nov 07 15:52:40 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:52:40 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:52:40 user nova-compute[75018]:       <nova:name>tempest-TestMinimumBasicScenario-server-48748734</nova:name>
Nov 07 15:52:40 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:52:40</nova:creationTime>
Nov 07 15:52:40 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:52:40 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:52:40 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:52:40 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:52:40 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:52:40 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:52:40 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:52:40 user nova-compute[75018]:       <nova:owner>
Nov 07 15:52:40 user nova-compute[75018]:         <nova:user uuid="d4927e184ba449c493a60d9580755235">tempest-TestMinimumBasicScenario-376924718-project-member</nova:user>
Nov 07 15:52:40 user nova-compute[75018]:         <nova:project uuid="1e9055a2f9df4fc1867db5de885f5430">tempest-TestMinimumBasicScenario-376924718</nova:project>
Nov 07 15:52:40 user nova-compute[75018]:       </nova:owner>
Nov 07 15:52:40 user nova-compute[75018]:       <nova:root type="image" uuid="5dd33011-f3aa-4c13-9516-b9d204cf2acd"/>
Nov 07 15:52:40 user nova-compute[75018]:       <nova:ports>
Nov 07 15:52:40 user nova-compute[75018]:         <nova:port uuid="1076a216-6e7e-4f2f-b36e-ecb712d3a509">
Nov 07 15:52:40 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 07 15:52:40 user nova-compute[75018]:         </nova:port>
Nov 07 15:52:40 user nova-compute[75018]:       </nova:ports>
Nov 07 15:52:40 user nova-compute[75018]:     </nova:instance>
Nov 07 15:52:40 user nova-compute[75018]:   </metadata>
Nov 07 15:52:40 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:52:40 user nova-compute[75018]:     <system>
Nov 07 15:52:40 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:52:40 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:52:40 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:52:40 user nova-compute[75018]:       <entry name="serial">bd1bd30b-90d6-4625-b47f-b84441f9fb26</entry>
Nov 07 15:52:40 user nova-compute[75018]:       <entry name="uuid">bd1bd30b-90d6-4625-b47f-b84441f9fb26</entry>
Nov 07 15:52:40 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:52:40 user nova-compute[75018]:     </system>
Nov 07 15:52:40 user nova-compute[75018]:   </sysinfo>
Nov 07 15:52:40 user nova-compute[75018]:   <os>
Nov 07 15:52:40 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:52:40 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:52:40 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:52:40 user nova-compute[75018]:   </os>
Nov 07 15:52:40 user nova-compute[75018]:   <features>
Nov 07 15:52:40 user nova-compute[75018]:     <acpi/>
Nov 07 15:52:40 user nova-compute[75018]:     <apic/>
Nov 07 15:52:40 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:52:40 user nova-compute[75018]:   </features>
Nov 07 15:52:40 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:52:40 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:52:40 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:52:40 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:52:40 user nova-compute[75018]:   </clock>
Nov 07 15:52:40 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:52:40 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:52:40 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:52:40 user nova-compute[75018]:   </cpu>
Nov 07 15:52:40 user nova-compute[75018]:   <devices>
Nov 07 15:52:40 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:52:40 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:52:40 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk"/>
Nov 07 15:52:40 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:52:40 user nova-compute[75018]:     </disk>
Nov 07 15:52:40 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:52:40 user nova-compute[75018]:       <mac address="fa:16:3e:f6:da:57"/>
Nov 07 15:52:40 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:52:40 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:52:40 user nova-compute[75018]:       <target dev="tap1076a216-6e"/>
Nov 07 15:52:40 user nova-compute[75018]:     </interface>
Nov 07 15:52:40 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:52:40 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/console.log" append="off"/>
Nov 07 15:52:40 user nova-compute[75018]:     </serial>
Nov 07 15:52:40 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:52:40 user nova-compute[75018]:     <video>
Nov 07 15:52:40 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:52:40 user nova-compute[75018]:     </video>
Nov 07 15:52:40 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:52:40 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:52:40 user nova-compute[75018]:     </rng>
Nov 07 15:52:40 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:52:40 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:52:40 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:52:40 user nova-compute[75018]:     </memballoon>
Nov 07 15:52:40 user nova-compute[75018]:   </devices>
Nov 07 15:52:40 user nova-compute[75018]: </domain>
Nov 07 15:52:40 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-48748734',display_name='tempest-TestMinimumBasicScenario-server-48748734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-48748734',id=45,image_ref='5dd33011-f3aa-4c13-9516-b9d204cf2acd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM177KbzSVqGPmKKMaocBIZVFMcB2d/EMs3wCzIH8khblWthttN7YIW70SV3K2uPu0EX4yIysKf7pqxmjwJ29uf8BmH8FLUN9E7rnlPitRt0R8o2SSOky//CBy8kCmrawA==',key_name='tempest-TestMinimumBasicScenario-556187429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e9055a2f9df4fc1867db5de885f5430',ramdisk_id='',reservation_id='r-9kwn2qyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5dd33011-f3aa-4c13-9516-b9d204cf2acd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-376924718',owner_user_name='tempest-TestMinimumBasicScenario-376924718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:52:38Z,user_data=None,user_id='d4927e184ba449c493a60d9580755235',uuid=bd1bd30b-90d6-4625-b47f-b84441f9fb26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converting VIF {"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:da:57,bridge_name='br-int',has_traffic_filtering=True,id=1076a216-6e7e-4f2f-b36e-ecb712d3a509,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1076a216-6e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG os_vif [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:da:57,bridge_name='br-int',has_traffic_filtering=True,id=1076a216-6e7e-4f2f-b36e-ecb712d3a509,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1076a216-6e') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f0a1d57-22e1-5a5d-b046-49a57d888ae0', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1076a216-6e, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1076a216-6e, col_values=(('qos', UUID('47a0f1b0-1b5d-49a8-98b7-c3d883fa23e3')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1076a216-6e, col_values=(('external_ids', {'iface-id': '1076a216-6e7e-4f2f-b36e-ecb712d3a509', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:da:57', 'vm-uuid': 'bd1bd30b-90d6-4625-b47f-b84441f9fb26'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:40 user nova-compute[75018]: INFO os_vif [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:da:57,bridge_name='br-int',has_traffic_filtering=True,id=1076a216-6e7e-4f2f-b36e-ecb712d3a509,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1076a216-6e')
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] No VIF found with MAC fa:16:3e:f6:da:57, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.network.neutron [req-5849a5a0-e3d1-48a0-8c95-b330d2fab9ff req-8bc2c2c2-2441-4485-84f9-8b8eae6f3786 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updated VIF entry in instance network info cache for port 1076a216-6e7e-4f2f-b36e-ecb712d3a509. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG nova.network.neutron [req-5849a5a0-e3d1-48a0-8c95-b330d2fab9ff req-8bc2c2c2-2441-4485-84f9-8b8eae6f3786 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updating instance_info_cache with network_info: [{"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:52:40 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5849a5a0-e3d1-48a0-8c95-b330d2fab9ff req-8bc2c2c2-2441-4485-84f9-8b8eae6f3786 service nova] Releasing lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:52:41 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:52:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:42 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:52:42 user nova-compute[75018]: DEBUG nova.compute.manager [req-9b86ed0b-1181-46b8-ba6a-7b2f10bab710 req-03e2b30f-fc84-40c7-a370-ec04b938d58c service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:52:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b86ed0b-1181-46b8-ba6a-7b2f10bab710 req-03e2b30f-fc84-40c7-a370-ec04b938d58c service nova] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b86ed0b-1181-46b8-ba6a-7b2f10bab710 req-03e2b30f-fc84-40c7-a370-ec04b938d58c service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9b86ed0b-1181-46b8-ba6a-7b2f10bab710 req-03e2b30f-fc84-40c7-a370-ec04b938d58c service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.013s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:42 user nova-compute[75018]: DEBUG nova.compute.manager [req-9b86ed0b-1181-46b8-ba6a-7b2f10bab710 req-03e2b30f-fc84-40c7-a370-ec04b938d58c service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] No waiting events found dispatching network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:52:42 user nova-compute[75018]: WARNING nova.compute.manager [req-9b86ed0b-1181-46b8-ba6a-7b2f10bab710 req-03e2b30f-fc84-40c7-a370-ec04b938d58c service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received unexpected event network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 for instance with vm_state building and task_state spawning.
Nov 07 15:52:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:52:44 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:52:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-8c01c3dc-6cac-4a70-b8a7-21544f956f23 req-0cff358d-295a-43a4-823b-1c79a06de569 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:52:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8c01c3dc-6cac-4a70-b8a7-21544f956f23 req-0cff358d-295a-43a4-823b-1c79a06de569 service nova] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8c01c3dc-6cac-4a70-b8a7-21544f956f23 req-0cff358d-295a-43a4-823b-1c79a06de569 service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8c01c3dc-6cac-4a70-b8a7-21544f956f23 req-0cff358d-295a-43a4-823b-1c79a06de569 service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-8c01c3dc-6cac-4a70-b8a7-21544f956f23 req-0cff358d-295a-43a4-823b-1c79a06de569 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] No waiting events found dispatching network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:52:44 user nova-compute[75018]: WARNING nova.compute.manager [req-8c01c3dc-6cac-4a70-b8a7-21544f956f23 req-0cff358d-295a-43a4-823b-1c79a06de569 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received unexpected event network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 for instance with vm_state building and task_state spawning.
Nov 07 15:52:44 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:52:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:52:44 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Instance spawned successfully.
Nov 07 15:52:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:52:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:52:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:52:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:52:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:52:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:52:44 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:52:44 user nova-compute[75018]: INFO nova.compute.manager [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 07 15:52:44 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:52:44 user nova-compute[75018]: INFO nova.compute.manager [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Took 7.08 seconds to build instance.
Nov 07 15:52:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1cb8670e-f509-4c86-8717-b1abae9e9dff tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.221s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:45 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:52:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:48 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:52:48 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:52:48 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 15:52:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:52:48 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:52:48 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:52:48 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:52:49 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updating instance_info_cache with network_info: [{"id": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "address": "fa:16:3e:9a:04:46", "network": {"id": "a71702a4-b590-4647-8237-28eb0fcd9230", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1031019268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c836eb1cc36a4724995e31466a2a8c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f42a26-dd", "ovs_interfaceid": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:52:49 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-64559109-6166-488d-a457-20b5f01ddf40" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:52:49 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:52:49 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:52:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:51 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:52:54 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:52:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:54 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:52:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:52:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:52:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:52:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:52:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:52:56 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:52:56 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:52:56 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8404MB free_disk=24.797122955322266GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:52:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:52:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:52:56 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 64559109-6166-488d-a457-20b5f01ddf40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:52:56 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:52:56 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:52:56 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance bd1bd30b-90d6-4625-b47f-b84441f9fb26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:52:56 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:52:56 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:52:56 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:52:57 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:52:57 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:52:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:52:59 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:53:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJqVauZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:53:07 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:53:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:53:07 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:53:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:53:07 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6f9b47-747d-46ec-902f-3f594772408d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:53:07 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f4c708-dd36-4074-b982-a5361a04a2ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d] added
Nov 07 15:53:07 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bd4116-0024-411b-a31e-beaaaebd5e95]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[af58aec6-569b-4fac-96f1-b32e83e2f432]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJqVauZB {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJqVauZB" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e8043b-b0ea-431a-9b28-63c0615805cb]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DJqVauZB'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f854833-969b-4b50-8dc4-1383ed5dd431]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[11259850-114b-4e82-ae8f-9652384732d6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:53:07 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:53:07 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9601b661-8c1c-40fd-bdfd-e013027b183f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d, portal: 172.16.0.220,3260]
Nov 07 15:53:07 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d, portal: 172.16.0.220,3260] successful.
Nov 07 15:53:07 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:53:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa83a15e-9b20-42ba-9a63-0a9d2cc63636]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b032a8f-d46d-4f09-a4f6-5dd8d919195d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:53:08 user nova-compute[75018]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d (non-flash)
Nov 07 15:53:08 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:53:08 user nova-compute[75018]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d (non-flash)
Nov 07 15:53:08 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[154eb100-96dc-41ae-b4ba-cfd301e903d0]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:08 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:53:09 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:53:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJqVauZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:53:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:53:09 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26664633131613137', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:53:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664633131613137', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:53:09 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lazy-loading 'flavor' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:53:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:53:09 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:53:09 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:53:09 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:53:09 user nova-compute[75018]:   <serial>0d85b079-dddc-4457-818b-6074a150354d</serial>
Nov 07 15:53:09 user nova-compute[75018]: </disk>
Nov 07 15:53:09 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:53:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:53:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:53:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] No VIF found with MAC fa:16:3e:9a:04:46, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:53:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c3b2b83e-19eb-48c7-a0f3-6dfca92cf039 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.746s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:53:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:53:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:53:12 user nova-compute[75018]: INFO nova.compute.manager [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Detaching volume 0d85b079-dddc-4457-818b-6074a150354d
Nov 07 15:53:12 user nova-compute[75018]: INFO nova.virt.block_device [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Attempting to driver detach volume 0d85b079-dddc-4457-818b-6074a150354d from mountpoint /dev/vdb
Nov 07 15:53:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Attempting to detach device vdb from instance 64559109-6166-488d-a457-20b5f01ddf40 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:53:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:53:12 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:53:12 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:53:12 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:53:12 user nova-compute[75018]:   <serial>0d85b079-dddc-4457-818b-6074a150354d</serial>
Nov 07 15:53:12 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:53:12 user nova-compute[75018]: </disk>
Nov 07 15:53:12 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:53:12 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Successfully detached device vdb from instance 64559109-6166-488d-a457-20b5f01ddf40 from the persistent domain config.
Nov 07 15:53:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64559109-6166-488d-a457-20b5f01ddf40 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:53:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:53:12 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:53:12 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:53:12 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:53:12 user nova-compute[75018]:   <serial>0d85b079-dddc-4457-818b-6074a150354d</serial>
Nov 07 15:53:12 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:53:12 user nova-compute[75018]: </disk>
Nov 07 15:53:12 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:53:12 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:53:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:53:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:53:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:53:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:53:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:53:32 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 64559109-6166-488d-a457-20b5f01ddf40 is timed out.
Nov 07 15:53:32 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Successfully detached device vdb from instance 64559109-6166-488d-a457-20b5f01ddf40 from the live domain config.
Nov 07 15:53:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:53:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJqVauZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:53:32 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:53:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:53:32 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:53:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:32 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eb42d8-932e-40cf-b3cc-f125027140c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:53:33 user nova-compute[75018]: No targets found.
Nov 07 15:53:33 user nova-compute[75018]: iSNS:
Nov 07 15:53:33 user nova-compute[75018]: No targets found.
Nov 07 15:53:33 user nova-compute[75018]: STATIC:
Nov 07 15:53:33 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9
Nov 07 15:53:33 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:53:33 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:53:33 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d
Nov 07 15:53:33 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:53:33 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:53:33 user nova-compute[75018]: FIRMWARE:
Nov 07 15:53:33 user nova-compute[75018]: No targets found.
Nov 07 15:53:33 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:53:33 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:53:33 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9f5d38-a9e9-49af-a24d-878cb91fe882]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b200ac5f-5a83-48d8-8d7c-60e874d71bf5]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:53:33 user nova-compute[75018]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d (non-flash)
Nov 07 15:53:33 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:53:33 user nova-compute[75018]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d (non-flash)
Nov 07 15:53:33 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae0330790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d'): ({'sdc'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Removing single pathed devices sdc {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddbd77a-c12a-4001-a96b-2133f147c703]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a2c09c-f5e9-4cd9-ac1e-625777fbfafe]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Flushing IO for device /dev/sdc {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a692edd6-020c-4e82-9929-89e86e689edd]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0675ee-ad19-4192-9ca0-7051539130e5]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee37adc6-5282-4d05-b46a-9c1fcfa4b365]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddb447d-eb24-44a3-b9e7-abe16b73f45d]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d, portal: 172.16.0.220,3260]
Nov 07 15:53:33 user nova-compute[75018]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d, portal: 172.16.0.220,3260] successful.
Nov 07 15:53:33 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d85b079-dddc-4457-818b-6074a150354d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bc7357-9db6-42db-9c46-cd021caedb04]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] <== disconnect_volume: return (298ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:53:33 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:53:34 user nova-compute[75018]: DEBUG nova.objects.instance [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lazy-loading 'flavor' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:53:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-77c0ddd1-632d-4fdd-9acf-5c141f3432a4 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.820s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:53:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:53:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:53:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:53:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:53:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:39 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:53:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:42 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:53:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:53:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:53:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:53:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:53:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:53:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:53:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:46 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:53:46 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:53:46 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:53:50 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:53:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:53:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:53:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:53:50 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:53:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:53:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:53:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:53:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:53:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:51 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updating instance_info_cache with network_info: [{"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:53:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:53:51 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:53:51 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:53:52 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:53:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:53:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:53:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:53:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:53:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:53:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:53:56 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:53:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:53:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:53:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:53:56 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:53:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:53:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:53:58 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:53:58 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:53:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8554MB free_disk=24.767562866210938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 64559109-6166-488d-a457-20b5f01ddf40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance bd1bd30b-90d6-4625-b47f-b84441f9fb26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:53:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:54:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:54:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:54:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:54:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:54:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:54:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:54:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:54:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:54:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:54:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:54:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:21 user nova-compute[75018]: INFO nova.compute.manager [None req-cd9ae2a5-ba31-4fbe-b753-161e7c0c20f7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Unrescuing
Nov 07 15:54:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-cd9ae2a5-ba31-4fbe-b753-161e7c0c20f7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:54:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-cd9ae2a5-ba31-4fbe-b753-161e7c0c20f7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquired lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:54:21 user nova-compute[75018]: DEBUG nova.network.neutron [None req-cd9ae2a5-ba31-4fbe-b753-161e7c0c20f7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:54:21 user nova-compute[75018]: DEBUG nova.network.neutron [None req-cd9ae2a5-ba31-4fbe-b753-161e7c0c20f7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updating instance_info_cache with network_info: [{"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:54:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-cd9ae2a5-ba31-4fbe-b753-161e7c0c20f7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Releasing lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:54:21 user nova-compute[75018]: DEBUG nova.objects.instance [None req-cd9ae2a5-ba31-4fbe-b753-161e7c0c20f7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'flavor' on Instance uuid fa037da8-53d1-4dcd-9478-59a9e9cfb726 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:54:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-a95277c5-15d0-4b44-b8c8-4070b9685692 req-e6c4b288-6333-405e-8f7e-80d83503bcf9 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-vif-unplugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:54:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a95277c5-15d0-4b44-b8c8-4070b9685692 req-e6c4b288-6333-405e-8f7e-80d83503bcf9 service nova] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:54:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a95277c5-15d0-4b44-b8c8-4070b9685692 req-e6c4b288-6333-405e-8f7e-80d83503bcf9 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:54:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a95277c5-15d0-4b44-b8c8-4070b9685692 req-e6c4b288-6333-405e-8f7e-80d83503bcf9 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:54:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-a95277c5-15d0-4b44-b8c8-4070b9685692 req-e6c4b288-6333-405e-8f7e-80d83503bcf9 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] No waiting events found dispatching network-vif-unplugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:54:22 user nova-compute[75018]: WARNING nova.compute.manager [req-a95277c5-15d0-4b44-b8c8-4070b9685692 req-e6c4b288-6333-405e-8f7e-80d83503bcf9 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received unexpected event network-vif-unplugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:54:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:22 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Instance destroyed successfully.
Nov 07 15:54:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-7e73e7aa-6225-4502-9526-2fa9157ca843 req-8d5f6df6-b857-4b71-af29-f45c3461e2d9 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:54:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7e73e7aa-6225-4502-9526-2fa9157ca843 req-8d5f6df6-b857-4b71-af29-f45c3461e2d9 service nova] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:54:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7e73e7aa-6225-4502-9526-2fa9157ca843 req-8d5f6df6-b857-4b71-af29-f45c3461e2d9 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:54:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7e73e7aa-6225-4502-9526-2fa9157ca843 req-8d5f6df6-b857-4b71-af29-f45c3461e2d9 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:54:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-7e73e7aa-6225-4502-9526-2fa9157ca843 req-8d5f6df6-b857-4b71-af29-f45c3461e2d9 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] No waiting events found dispatching network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:54:24 user nova-compute[75018]: WARNING nova.compute.manager [req-7e73e7aa-6225-4502-9526-2fa9157ca843 req-8d5f6df6-b857-4b71-af29-f45c3461e2d9 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received unexpected event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:54:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-7e73e7aa-6225-4502-9526-2fa9157ca843 req-8d5f6df6-b857-4b71-af29-f45c3461e2d9 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:54:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7e73e7aa-6225-4502-9526-2fa9157ca843 req-8d5f6df6-b857-4b71-af29-f45c3461e2d9 service nova] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:54:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7e73e7aa-6225-4502-9526-2fa9157ca843 req-8d5f6df6-b857-4b71-af29-f45c3461e2d9 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:54:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7e73e7aa-6225-4502-9526-2fa9157ca843 req-8d5f6df6-b857-4b71-af29-f45c3461e2d9 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:54:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-7e73e7aa-6225-4502-9526-2fa9157ca843 req-8d5f6df6-b857-4b71-af29-f45c3461e2d9 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] No waiting events found dispatching network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:54:24 user nova-compute[75018]: WARNING nova.compute.manager [req-7e73e7aa-6225-4502-9526-2fa9157ca843 req-8d5f6df6-b857-4b71-af29-f45c3461e2d9 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received unexpected event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 for instance with vm_state rescued and task_state unrescuing.
Nov 07 15:54:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:26 user nova-compute[75018]: DEBUG nova.compute.manager [None req-cd9ae2a5-ba31-4fbe-b753-161e7c0c20f7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:54:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:26 user nova-compute[75018]: DEBUG nova.compute.manager [req-5d56d61a-2f62-4140-9311-c65320c1385c req-d58242ff-0d46-4282-a70a-80444fcc08f7 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:54:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5d56d61a-2f62-4140-9311-c65320c1385c req-d58242ff-0d46-4282-a70a-80444fcc08f7 service nova] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:54:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5d56d61a-2f62-4140-9311-c65320c1385c req-d58242ff-0d46-4282-a70a-80444fcc08f7 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:54:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-5d56d61a-2f62-4140-9311-c65320c1385c req-d58242ff-0d46-4282-a70a-80444fcc08f7 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:54:26 user nova-compute[75018]: DEBUG nova.compute.manager [req-5d56d61a-2f62-4140-9311-c65320c1385c req-d58242ff-0d46-4282-a70a-80444fcc08f7 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] No waiting events found dispatching network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:54:26 user nova-compute[75018]: WARNING nova.compute.manager [req-5d56d61a-2f62-4140-9311-c65320c1385c req-d58242ff-0d46-4282-a70a-80444fcc08f7 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received unexpected event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 for instance with vm_state active and task_state None.
Nov 07 15:54:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG nova.objects.instance [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'flavor' on Instance uuid bd1bd30b-90d6-4625-b47f-b84441f9fb26 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:54:34 user nova-compute[75018]: INFO nova.compute.manager [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Attaching volume 2ebff817-d13c-4fbc-9084-05dcedede24f to /dev/vdb
Nov 07 15:54:34 user nova-compute[75018]: DEBUG os_brick.utils [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0babf63-2fd5-4183-86be-ffbe36863353]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d2eb72-5fd9-460d-bcda-8321d59016d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a22824-057c-4c24-9bec-d7cde83c2eb4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c1befa-abb2-40cd-a895-ed87aa45df10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 15:54:34 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 15:54:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5253a142-cd1d-4f79-af10-15b7bbe53378]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG os_brick.utils [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:54:34 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updating existing volume attachment record: b95be31e-4f5e-440c-b4f6-13315f1cc05b {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 15:54:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:54:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:54:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:54:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:54:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:54:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:41 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:54:43 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:54:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:54:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:54:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:54:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:54:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:46 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:54:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:54:48 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:54:48 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:54:50 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:54:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:54:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:54:50 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:54:50 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:54:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:54:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:54:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:54:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:54:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:51 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updating instance_info_cache with network_info: [{"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:54:51 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:54:51 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:54:51 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:54:52 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLMShYPi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:54:55 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:54:55 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:54:55 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9144f723-3d77-44f2-ae02-9712f18cf62b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 15:54:55 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[70566d42-ba84-441f-8efe-3cc766b6977a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f] added
Nov 07 15:54:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bc741c-6575-4cfb-9f65-53ade3c90f80]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3055bdba-ab2b-49ec-85b2-aec5a9c2b0d9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aLMShYPi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aLMShYPi" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bd0ce7-ad50-441d-ba8b-e2f1efd39194]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aLMShYPi'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[103f6510-b920-4911-a8fd-01f46c841d99]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff5410f-4802-4d3e-bf6e-da5685ee19c6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:54:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:54:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40807f5-1aca-4c6c-84d4-bdc19693e34f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f, portal: 172.16.0.220,3260]
Nov 07 15:54:55 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f, portal: 172.16.0.220,3260] successful.
Nov 07 15:54:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[116251b7-8774-4c97-a1a1-4eeabb6fbb0a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[57780110-fd88-47e9-aa47-0de43e575ae4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:54:55 user nova-compute[75018]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f (non-flash)
Nov 07 15:54:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:54:55 user nova-compute[75018]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f (non-flash)
Nov 07 15:54:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f561af-3743-4f32-9b37-fbf0d06e7fdd]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 15:54:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLMShYPi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 15:54:56 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:54:56 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:54:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:54:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:54:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:54:56 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:54:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:56 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:56 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:54:56 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26337633635326166', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:54:56 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337633635326166', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG nova.objects.instance [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'flavor' on Instance uuid bd1bd30b-90d6-4625-b47f-b84441f9fb26 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 15:54:57 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:54:57 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:54:57 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:54:57 user nova-compute[75018]:   <serial>2ebff817-d13c-4fbc-9084-05dcedede24f</serial>
Nov 07 15:54:57 user nova-compute[75018]: </disk>
Nov 07 15:54:57 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] No VIF found with MAC fa:16:3e:f6:da:57, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-af61ba4d-4802-4bb8-a515-1743b06dc19e tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.329s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:54:57 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:54:58 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:54:58 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:54:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8642MB free_disk=24.76705551147461GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:54:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:54:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:54:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 64559109-6166-488d-a457-20b5f01ddf40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:54:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:54:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:54:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance bd1bd30b-90d6-4625-b47f-b84441f9fb26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:54:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:54:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:54:58 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:54:58 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:54:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:54:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:55:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-555c77f2-7755-4b2f-b263-7e746f73873f req-78384d66-ee16-462c-9ff0-9bd74aa06020 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-changed-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:55:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-555c77f2-7755-4b2f-b263-7e746f73873f req-78384d66-ee16-462c-9ff0-9bd74aa06020 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Refreshing instance network info cache due to event network-changed-1076a216-6e7e-4f2f-b36e-ecb712d3a509. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:55:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-555c77f2-7755-4b2f-b263-7e746f73873f req-78384d66-ee16-462c-9ff0-9bd74aa06020 service nova] Acquiring lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:55:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-555c77f2-7755-4b2f-b263-7e746f73873f req-78384d66-ee16-462c-9ff0-9bd74aa06020 service nova] Acquired lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:55:00 user nova-compute[75018]: DEBUG nova.network.neutron [req-555c77f2-7755-4b2f-b263-7e746f73873f req-78384d66-ee16-462c-9ff0-9bd74aa06020 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Refreshing network info cache for port 1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:55:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:00 user nova-compute[75018]: DEBUG nova.network.neutron [req-555c77f2-7755-4b2f-b263-7e746f73873f req-78384d66-ee16-462c-9ff0-9bd74aa06020 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updated VIF entry in instance network info cache for port 1076a216-6e7e-4f2f-b36e-ecb712d3a509. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:55:00 user nova-compute[75018]: DEBUG nova.network.neutron [req-555c77f2-7755-4b2f-b263-7e746f73873f req-78384d66-ee16-462c-9ff0-9bd74aa06020 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updating instance_info_cache with network_info: [{"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:55:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-555c77f2-7755-4b2f-b263-7e746f73873f req-78384d66-ee16-462c-9ff0-9bd74aa06020 service nova] Releasing lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:55:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:02 user nova-compute[75018]: DEBUG nova.compute.manager [req-9e9edfbf-7c84-4b82-90a0-da02ddbc0d4f req-647ece1e-d4ad-4e1e-bcbd-9ac4554686c7 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-changed-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:55:02 user nova-compute[75018]: DEBUG nova.compute.manager [req-9e9edfbf-7c84-4b82-90a0-da02ddbc0d4f req-647ece1e-d4ad-4e1e-bcbd-9ac4554686c7 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Refreshing instance network info cache due to event network-changed-1076a216-6e7e-4f2f-b36e-ecb712d3a509. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:55:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9e9edfbf-7c84-4b82-90a0-da02ddbc0d4f req-647ece1e-d4ad-4e1e-bcbd-9ac4554686c7 service nova] Acquiring lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:55:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9e9edfbf-7c84-4b82-90a0-da02ddbc0d4f req-647ece1e-d4ad-4e1e-bcbd-9ac4554686c7 service nova] Acquired lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:55:02 user nova-compute[75018]: DEBUG nova.network.neutron [req-9e9edfbf-7c84-4b82-90a0-da02ddbc0d4f req-647ece1e-d4ad-4e1e-bcbd-9ac4554686c7 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Refreshing network info cache for port 1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:55:03 user nova-compute[75018]: DEBUG nova.network.neutron [req-9e9edfbf-7c84-4b82-90a0-da02ddbc0d4f req-647ece1e-d4ad-4e1e-bcbd-9ac4554686c7 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updated VIF entry in instance network info cache for port 1076a216-6e7e-4f2f-b36e-ecb712d3a509. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:55:03 user nova-compute[75018]: DEBUG nova.network.neutron [req-9e9edfbf-7c84-4b82-90a0-da02ddbc0d4f req-647ece1e-d4ad-4e1e-bcbd-9ac4554686c7 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updating instance_info_cache with network_info: [{"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:55:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9e9edfbf-7c84-4b82-90a0-da02ddbc0d4f req-647ece1e-d4ad-4e1e-bcbd-9ac4554686c7 service nova] Releasing lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:55:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f96fc02-944e-4d95-adf1-35b223da17f7 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:55:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f96fc02-944e-4d95-adf1-35b223da17f7 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:55:03 user nova-compute[75018]: INFO nova.compute.manager [None req-6f96fc02-944e-4d95-adf1-35b223da17f7 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Rebooting instance
Nov 07 15:55:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f96fc02-944e-4d95-adf1-35b223da17f7 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:55:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f96fc02-944e-4d95-adf1-35b223da17f7 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquired lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:55:03 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6f96fc02-944e-4d95-adf1-35b223da17f7 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:55:03 user nova-compute[75018]: DEBUG nova.network.neutron [None req-6f96fc02-944e-4d95-adf1-35b223da17f7 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updating instance_info_cache with network_info: [{"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:55:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f96fc02-944e-4d95-adf1-35b223da17f7 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Releasing lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:55:03 user nova-compute[75018]: DEBUG nova.compute.manager [None req-6f96fc02-944e-4d95-adf1-35b223da17f7 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:55:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:06 user nova-compute[75018]: DEBUG nova.compute.manager [req-3ee4af17-f0c6-4315-b0ca-33a26c556a80 req-c396de60-c988-4f91-8566-abf9e8ea3f34 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-vif-unplugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:55:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3ee4af17-f0c6-4315-b0ca-33a26c556a80 req-c396de60-c988-4f91-8566-abf9e8ea3f34 service nova] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:55:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3ee4af17-f0c6-4315-b0ca-33a26c556a80 req-c396de60-c988-4f91-8566-abf9e8ea3f34 service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:55:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3ee4af17-f0c6-4315-b0ca-33a26c556a80 req-c396de60-c988-4f91-8566-abf9e8ea3f34 service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:55:06 user nova-compute[75018]: DEBUG nova.compute.manager [req-3ee4af17-f0c6-4315-b0ca-33a26c556a80 req-c396de60-c988-4f91-8566-abf9e8ea3f34 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] No waiting events found dispatching network-vif-unplugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:55:06 user nova-compute[75018]: WARNING nova.compute.manager [req-3ee4af17-f0c6-4315-b0ca-33a26c556a80 req-c396de60-c988-4f91-8566-abf9e8ea3f34 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received unexpected event network-vif-unplugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 for instance with vm_state active and task_state reboot_started.
Nov 07 15:55:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:06 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-6f96fc02-944e-4d95-adf1-35b223da17f7 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Instance shutdown successfully.
Nov 07 15:55:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-cbf05410-0852-4c49-a0af-63a2d958cbf3 req-83fa50a9-4543-44ed-a6b5-25420bbd195d service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:55:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cbf05410-0852-4c49-a0af-63a2d958cbf3 req-83fa50a9-4543-44ed-a6b5-25420bbd195d service nova] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:55:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cbf05410-0852-4c49-a0af-63a2d958cbf3 req-83fa50a9-4543-44ed-a6b5-25420bbd195d service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:55:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cbf05410-0852-4c49-a0af-63a2d958cbf3 req-83fa50a9-4543-44ed-a6b5-25420bbd195d service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:55:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-cbf05410-0852-4c49-a0af-63a2d958cbf3 req-83fa50a9-4543-44ed-a6b5-25420bbd195d service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] No waiting events found dispatching network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:55:08 user nova-compute[75018]: WARNING nova.compute.manager [req-cbf05410-0852-4c49-a0af-63a2d958cbf3 req-83fa50a9-4543-44ed-a6b5-25420bbd195d service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received unexpected event network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 for instance with vm_state active and task_state reboot_started.
Nov 07 15:55:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-cbf05410-0852-4c49-a0af-63a2d958cbf3 req-83fa50a9-4543-44ed-a6b5-25420bbd195d service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:55:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cbf05410-0852-4c49-a0af-63a2d958cbf3 req-83fa50a9-4543-44ed-a6b5-25420bbd195d service nova] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:55:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cbf05410-0852-4c49-a0af-63a2d958cbf3 req-83fa50a9-4543-44ed-a6b5-25420bbd195d service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:55:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cbf05410-0852-4c49-a0af-63a2d958cbf3 req-83fa50a9-4543-44ed-a6b5-25420bbd195d service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:55:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-cbf05410-0852-4c49-a0af-63a2d958cbf3 req-83fa50a9-4543-44ed-a6b5-25420bbd195d service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] No waiting events found dispatching network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:55:08 user nova-compute[75018]: WARNING nova.compute.manager [req-cbf05410-0852-4c49-a0af-63a2d958cbf3 req-83fa50a9-4543-44ed-a6b5-25420bbd195d service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received unexpected event network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 for instance with vm_state active and task_state reboot_started.
Nov 07 15:55:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:10 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Instance running successfully.
Nov 07 15:55:10 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-6f96fc02-944e-4d95-adf1-35b223da17f7 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Instance soft rebooted successfully.
Nov 07 15:55:10 user nova-compute[75018]: DEBUG nova.compute.manager [None req-6f96fc02-944e-4d95-adf1-35b223da17f7 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:55:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6f96fc02-944e-4d95-adf1-35b223da17f7 tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.136s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:55:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-c5a96b21-145a-4474-bf10-1a0d469f70db req-31675878-73d2-40e0-a78d-54962bc3eb92 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:55:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c5a96b21-145a-4474-bf10-1a0d469f70db req-31675878-73d2-40e0-a78d-54962bc3eb92 service nova] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:55:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c5a96b21-145a-4474-bf10-1a0d469f70db req-31675878-73d2-40e0-a78d-54962bc3eb92 service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:55:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c5a96b21-145a-4474-bf10-1a0d469f70db req-31675878-73d2-40e0-a78d-54962bc3eb92 service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:55:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-c5a96b21-145a-4474-bf10-1a0d469f70db req-31675878-73d2-40e0-a78d-54962bc3eb92 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] No waiting events found dispatching network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:55:10 user nova-compute[75018]: WARNING nova.compute.manager [req-c5a96b21-145a-4474-bf10-1a0d469f70db req-31675878-73d2-40e0-a78d-54962bc3eb92 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received unexpected event network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 for instance with vm_state active and task_state None.
Nov 07 15:55:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:55:20 user nova-compute[75018]: INFO nova.compute.manager [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Terminating instance
Nov 07 15:55:20 user nova-compute[75018]: DEBUG nova.compute.manager [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-abb84a6d-a38e-4ee0-9edf-2799b74d9e71 req-6d9f9425-dba2-4022-91a4-4e2c0ebc6efa service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Received event network-vif-unplugged-46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-abb84a6d-a38e-4ee0-9edf-2799b74d9e71 req-6d9f9425-dba2-4022-91a4-4e2c0ebc6efa service nova] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-abb84a6d-a38e-4ee0-9edf-2799b74d9e71 req-6d9f9425-dba2-4022-91a4-4e2c0ebc6efa service nova] Lock "64559109-6166-488d-a457-20b5f01ddf40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-abb84a6d-a38e-4ee0-9edf-2799b74d9e71 req-6d9f9425-dba2-4022-91a4-4e2c0ebc6efa service nova] Lock "64559109-6166-488d-a457-20b5f01ddf40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-abb84a6d-a38e-4ee0-9edf-2799b74d9e71 req-6d9f9425-dba2-4022-91a4-4e2c0ebc6efa service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] No waiting events found dispatching network-vif-unplugged-46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-abb84a6d-a38e-4ee0-9edf-2799b74d9e71 req-6d9f9425-dba2-4022-91a4-4e2c0ebc6efa service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Received event network-vif-unplugged-46f42a26-dde5-43b8-a247-c6e8b56a96de for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:55:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:21 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Instance destroyed successfully.
Nov 07 15:55:21 user nova-compute[75018]: DEBUG nova.objects.instance [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lazy-loading 'resources' on Instance uuid 64559109-6166-488d-a457-20b5f01ddf40 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1868741104',display_name='tempest-SnapshotDataIntegrityTests-server-1868741104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1868741104',id=40,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMoqJVJpTqe3QrlEI329rti+/tKDrp+Mf65h7IftV93ygtjf+nXuM72IPT27LRDnU/O9wEEGTDZFArZN6xgj1i4wj59TrD/sBMYL/7QuosZ859OT+96K7w5Wr5ZugG1+A==',key_name='tempest-keypair-441338183',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:45:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c836eb1cc36a4724995e31466a2a8c56',ramdisk_id='',reservation_id='r-45i8d4w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1770219978',owner_user_name='tempest-SnapshotDataIntegrityTests-1770219978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:45:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539a5c7025bc4f8a8d68892e015cbab0',uuid=64559109-6166-488d-a457-20b5f01ddf40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "address": "fa:16:3e:9a:04:46", "network": {"id": "a71702a4-b590-4647-8237-28eb0fcd9230", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1031019268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c836eb1cc36a4724995e31466a2a8c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f42a26-dd", "ovs_interfaceid": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Converting VIF {"id": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "address": "fa:16:3e:9a:04:46", "network": {"id": "a71702a4-b590-4647-8237-28eb0fcd9230", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1031019268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c836eb1cc36a4724995e31466a2a8c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46f42a26-dd", "ovs_interfaceid": "46f42a26-dde5-43b8-a247-c6e8b56a96de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:04:46,bridge_name='br-int',has_traffic_filtering=True,id=46f42a26-dde5-43b8-a247-c6e8b56a96de,network=Network(a71702a4-b590-4647-8237-28eb0fcd9230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f42a26-dd') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG os_vif [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:04:46,bridge_name='br-int',has_traffic_filtering=True,id=46f42a26-dde5-43b8-a247-c6e8b56a96de,network=Network(a71702a4-b590-4647-8237-28eb0fcd9230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f42a26-dd') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46f42a26-dd, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bb9e19e-8361-47c4-a63c-488ae02e2e6b) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:21 user nova-compute[75018]: INFO os_vif [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:04:46,bridge_name='br-int',has_traffic_filtering=True,id=46f42a26-dde5-43b8-a247-c6e8b56a96de,network=Network(a71702a4-b590-4647-8237-28eb0fcd9230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46f42a26-dd')
Nov 07 15:55:21 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Deleting instance files /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40_del
Nov 07 15:55:21 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Deletion of /opt/stack/data/nova/instances/64559109-6166-488d-a457-20b5f01ddf40_del complete
Nov 07 15:55:21 user nova-compute[75018]: INFO nova.compute.manager [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 07 15:55:21 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 64559109-6166-488d-a457-20b5f01ddf40] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:55:21 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:55:21 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Took 0.81 seconds to deallocate network for instance.
Nov 07 15:55:21 user nova-compute[75018]: DEBUG nova.compute.manager [req-6f5703a1-28f9-42da-bb8d-9ed65ed3be45 req-228c740f-ac51-4ffa-a02f-c761bea6a423 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Received event network-vif-deleted-46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:55:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:55:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:55:22 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:55:22 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:55:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:55:22 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Deleted allocations for instance 64559109-6166-488d-a457-20b5f01ddf40
Nov 07 15:55:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-7e9dda8f-5345-405c-8e8d-3276f6fa8b88 tempest-SnapshotDataIntegrityTests-1770219978 tempest-SnapshotDataIntegrityTests-1770219978-project-member] Lock "64559109-6166-488d-a457-20b5f01ddf40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.094s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:55:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-b74c41ec-f198-4410-ae49-5e1587c4a3f6 req-96b5e782-263e-4358-adc6-5d5c10ce0854 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Received event network-vif-plugged-46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:55:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b74c41ec-f198-4410-ae49-5e1587c4a3f6 req-96b5e782-263e-4358-adc6-5d5c10ce0854 service nova] Acquiring lock "64559109-6166-488d-a457-20b5f01ddf40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:55:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b74c41ec-f198-4410-ae49-5e1587c4a3f6 req-96b5e782-263e-4358-adc6-5d5c10ce0854 service nova] Lock "64559109-6166-488d-a457-20b5f01ddf40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:55:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-b74c41ec-f198-4410-ae49-5e1587c4a3f6 req-96b5e782-263e-4358-adc6-5d5c10ce0854 service nova] Lock "64559109-6166-488d-a457-20b5f01ddf40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:55:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-b74c41ec-f198-4410-ae49-5e1587c4a3f6 req-96b5e782-263e-4358-adc6-5d5c10ce0854 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] No waiting events found dispatching network-vif-plugged-46f42a26-dde5-43b8-a247-c6e8b56a96de {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:55:22 user nova-compute[75018]: WARNING nova.compute.manager [req-b74c41ec-f198-4410-ae49-5e1587c4a3f6 req-96b5e782-263e-4358-adc6-5d5c10ce0854 service nova] [instance: 64559109-6166-488d-a457-20b5f01ddf40] Received unexpected event network-vif-plugged-46f42a26-dde5-43b8-a247-c6e8b56a96de for instance with vm_state deleted and task_state None.
Nov 07 15:55:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:42 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:55:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:55:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:46 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:55:48 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:55:48 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:55:49 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:55:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:55:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:55:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:55:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:55:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:51 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:55:52 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:55:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:55:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:55:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:55:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:55:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updating instance_info_cache with network_info: [{"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:55:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:55:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:55:53 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:55:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:55:58 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:55:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:55:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:55:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:55:58 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:55:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:55:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:55:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:55:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:55:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:55:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:55:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:55:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:55:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:55:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:55:59 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:55:59 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:55:59 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=24.793087005615234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:55:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:55:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:55:59 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:55:59 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:55:59 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance bd1bd30b-90d6-4625-b47f-b84441f9fb26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:55:59 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:55:59 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:56:00 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:56:00 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:56:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:56:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:56:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:56:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "37a43352-eebc-4cea-84c7-0a337e7f9063" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 15:56:13 user nova-compute[75018]: INFO nova.compute.claims [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Claim successful on node user
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Verify base images {{(pid=75018) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Image id 667dc137-8627-496e-9a1f-9f5738befeda yields fingerprint 52a35dfab40930b0700886ab54f4da47f590460e {{(pid=75018) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 07 15:56:13 user nova-compute[75018]: INFO nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] image 667dc137-8627-496e-9a1f-9f5738befeda at (/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e): checking
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] image 667dc137-8627-496e-9a1f-9f5738befeda at (/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e): image is in use {{(pid=75018) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75018) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Image id 5dd33011-f3aa-4c13-9516-b9d204cf2acd yields fingerprint 7f8b25bbcd05154251d97577f3daf041a3836237 {{(pid=75018) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 07 15:56:13 user nova-compute[75018]: INFO nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] image 5dd33011-f3aa-4c13-9516-b9d204cf2acd at (/opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237): checking
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] image 5dd33011-f3aa-4c13-9516-b9d204cf2acd at (/opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237): image is in use {{(pid=75018) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] 8e787e6f-2844-4407-ba44-a60b5830cdab is a valid instance name {{(pid=75018) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] 8e787e6f-2844-4407-ba44-a60b5830cdab has a disk file {{(pid=75018) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab is backed by 52a35dfab40930b0700886ab54f4da47f590460e {{(pid=75018) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] bd1bd30b-90d6-4625-b47f-b84441f9fb26 is a valid instance name {{(pid=75018) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] bd1bd30b-90d6-4625-b47f-b84441f9fb26 has a disk file {{(pid=75018) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.network.neutron [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 15:56:13 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 15:56:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG nova.policy [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b85e59486dda47eeb7b0cf5ddf732ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b703f914a00c4d5399fbd2a05d855e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance bd1bd30b-90d6-4625-b47f-b84441f9fb26 is backed by 7f8b25bbcd05154251d97577f3daf041a3836237 {{(pid=75018) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] fa037da8-53d1-4dcd-9478-59a9e9cfb726 is a valid instance name {{(pid=75018) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 07 15:56:14 user nova-compute[75018]: WARNING nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f
Nov 07 15:56:14 user nova-compute[75018]: WARNING nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351
Nov 07 15:56:14 user nova-compute[75018]: WARNING nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122
Nov 07 15:56:14 user nova-compute[75018]: WARNING nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4
Nov 07 15:56:14 user nova-compute[75018]: WARNING nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98
Nov 07 15:56:14 user nova-compute[75018]: WARNING nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728
Nov 07 15:56:14 user nova-compute[75018]: WARNING nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21
Nov 07 15:56:14 user nova-compute[75018]: INFO nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Active base files: /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e /opt/stack/data/nova/instances/_base/7f8b25bbcd05154251d97577f3daf041a3836237
Nov 07 15:56:14 user nova-compute[75018]: INFO nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Removable base files: /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351 /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122 /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4 /opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98 /opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728 /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21
Nov 07 15:56:14 user nova-compute[75018]: INFO nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bb5561fee7baa1b3e9e81addb727cf3eedb56a8f
Nov 07 15:56:14 user nova-compute[75018]: INFO nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f752fd49fbc48e946341b48e6cbab5e889fb4351
Nov 07 15:56:14 user nova-compute[75018]: INFO nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/01345541bb3f34c21fba0fe1408a4fc36e885122
Nov 07 15:56:14 user nova-compute[75018]: INFO nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/152f08dabc120cf40a68fdac50337888e97430f4
Nov 07 15:56:14 user nova-compute[75018]: INFO nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/545d2d77eef7da8f1a787b7eec60c99b6a83ed98
Nov 07 15:56:14 user nova-compute[75018]: INFO nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d9c4d30e262b29368a14231355256c5e4c161728
Nov 07 15:56:14 user nova-compute[75018]: INFO nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/39df42a66cbdf988ea5b498650b17b4d94d8af21
Nov 07 15:56:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Verification complete {{(pid=75018) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Verify swap images {{(pid=75018) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.imagecache [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Verify ephemeral images {{(pid=75018) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 15:56:14 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Creating image(s)
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "/opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "/opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "/opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.192s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk 1073741824" returned: 0 in 0.059s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG nova.network.neutron [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Successfully created port: 679c8723-2d01-42eb-b7f7-0a766b635f98 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.191s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Cannot resize image /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Ensure instance console log exists: /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:56:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.network.neutron [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Successfully updated port: 679c8723-2d01-42eb-b7f7-0a766b635f98 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquired lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.network.neutron [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.compute.manager [req-ed169729-e2d9-430c-ab13-3c23ea702fd8 req-bf747022-ec17-4b0c-952f-e074db471b54 service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Received event network-changed-679c8723-2d01-42eb-b7f7-0a766b635f98 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.compute.manager [req-ed169729-e2d9-430c-ab13-3c23ea702fd8 req-bf747022-ec17-4b0c-952f-e074db471b54 service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Refreshing instance network info cache due to event network-changed-679c8723-2d01-42eb-b7f7-0a766b635f98. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ed169729-e2d9-430c-ab13-3c23ea702fd8 req-bf747022-ec17-4b0c-952f-e074db471b54 service nova] Acquiring lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.network.neutron [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.network.neutron [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Updating instance_info_cache with network_info: [{"id": "679c8723-2d01-42eb-b7f7-0a766b635f98", "address": "fa:16:3e:43:30:1d", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c8723-2d", "ovs_interfaceid": "679c8723-2d01-42eb-b7f7-0a766b635f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Releasing lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Instance network_info: |[{"id": "679c8723-2d01-42eb-b7f7-0a766b635f98", "address": "fa:16:3e:43:30:1d", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c8723-2d", "ovs_interfaceid": "679c8723-2d01-42eb-b7f7-0a766b635f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ed169729-e2d9-430c-ab13-3c23ea702fd8 req-bf747022-ec17-4b0c-952f-e074db471b54 service nova] Acquired lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.network.neutron [req-ed169729-e2d9-430c-ab13-3c23ea702fd8 req-bf747022-ec17-4b0c-952f-e074db471b54 service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Refreshing network info cache for port 679c8723-2d01-42eb-b7f7-0a766b635f98 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Start _get_guest_xml network_info=[{"id": "679c8723-2d01-42eb-b7f7-0a766b635f98", "address": "fa:16:3e:43:30:1d", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c8723-2d", "ovs_interfaceid": "679c8723-2d01-42eb-b7f7-0a766b635f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 15:56:15 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:56:15 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1011584129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1011584129',id=46,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b703f914a00c4d5399fbd2a05d855e20',ramdisk_id='',reservation_id='r-ca83hunm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:56:14Z,user_data=None,user_id='b85e59486dda47eeb7b0cf5ddf732ecf',uuid=37a43352-eebc-4cea-84c7-0a337e7f9063,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "679c8723-2d01-42eb-b7f7-0a766b635f98", "address": "fa:16:3e:43:30:1d", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c8723-2d", "ovs_interfaceid": "679c8723-2d01-42eb-b7f7-0a766b635f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converting VIF {"id": "679c8723-2d01-42eb-b7f7-0a766b635f98", "address": "fa:16:3e:43:30:1d", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c8723-2d", "ovs_interfaceid": "679c8723-2d01-42eb-b7f7-0a766b635f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:30:1d,bridge_name='br-int',has_traffic_filtering=True,id=679c8723-2d01-42eb-b7f7-0a766b635f98,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679c8723-2d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.objects.instance [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'pci_devices' on Instance uuid 37a43352-eebc-4cea-84c7-0a337e7f9063 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] End _get_guest_xml xml=<domain type="kvm">
Nov 07 15:56:15 user nova-compute[75018]:   <uuid>37a43352-eebc-4cea-84c7-0a337e7f9063</uuid>
Nov 07 15:56:15 user nova-compute[75018]:   <name>instance-0000002e</name>
Nov 07 15:56:15 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 15:56:15 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 15:56:15 user nova-compute[75018]:   <metadata>
Nov 07 15:56:15 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 15:56:15 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 15:56:15 user nova-compute[75018]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1011584129</nova:name>
Nov 07 15:56:15 user nova-compute[75018]:       <nova:creationTime>2023-11-07 15:56:15</nova:creationTime>
Nov 07 15:56:15 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 15:56:15 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 15:56:15 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 15:56:15 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 15:56:15 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 15:56:15 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 15:56:15 user nova-compute[75018]:       </nova:flavor>
Nov 07 15:56:15 user nova-compute[75018]:       <nova:owner>
Nov 07 15:56:15 user nova-compute[75018]:         <nova:user uuid="b85e59486dda47eeb7b0cf5ddf732ecf">tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member</nova:user>
Nov 07 15:56:15 user nova-compute[75018]:         <nova:project uuid="b703f914a00c4d5399fbd2a05d855e20">tempest-ServerBootFromVolumeStableRescueTest-1314994176</nova:project>
Nov 07 15:56:15 user nova-compute[75018]:       </nova:owner>
Nov 07 15:56:15 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 15:56:15 user nova-compute[75018]:       <nova:ports>
Nov 07 15:56:15 user nova-compute[75018]:         <nova:port uuid="679c8723-2d01-42eb-b7f7-0a766b635f98">
Nov 07 15:56:15 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 07 15:56:15 user nova-compute[75018]:         </nova:port>
Nov 07 15:56:15 user nova-compute[75018]:       </nova:ports>
Nov 07 15:56:15 user nova-compute[75018]:     </nova:instance>
Nov 07 15:56:15 user nova-compute[75018]:   </metadata>
Nov 07 15:56:15 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 15:56:15 user nova-compute[75018]:     <system>
Nov 07 15:56:15 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 15:56:15 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 15:56:15 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 15:56:15 user nova-compute[75018]:       <entry name="serial">37a43352-eebc-4cea-84c7-0a337e7f9063</entry>
Nov 07 15:56:15 user nova-compute[75018]:       <entry name="uuid">37a43352-eebc-4cea-84c7-0a337e7f9063</entry>
Nov 07 15:56:15 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 15:56:15 user nova-compute[75018]:     </system>
Nov 07 15:56:15 user nova-compute[75018]:   </sysinfo>
Nov 07 15:56:15 user nova-compute[75018]:   <os>
Nov 07 15:56:15 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 15:56:15 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 15:56:15 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 15:56:15 user nova-compute[75018]:   </os>
Nov 07 15:56:15 user nova-compute[75018]:   <features>
Nov 07 15:56:15 user nova-compute[75018]:     <acpi/>
Nov 07 15:56:15 user nova-compute[75018]:     <apic/>
Nov 07 15:56:15 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 15:56:15 user nova-compute[75018]:   </features>
Nov 07 15:56:15 user nova-compute[75018]:   <clock offset="utc">
Nov 07 15:56:15 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 15:56:15 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 15:56:15 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 15:56:15 user nova-compute[75018]:   </clock>
Nov 07 15:56:15 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 15:56:15 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 15:56:15 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 15:56:15 user nova-compute[75018]:   </cpu>
Nov 07 15:56:15 user nova-compute[75018]:   <devices>
Nov 07 15:56:15 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 15:56:15 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 15:56:15 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk"/>
Nov 07 15:56:15 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 15:56:15 user nova-compute[75018]:     </disk>
Nov 07 15:56:15 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 15:56:15 user nova-compute[75018]:       <mac address="fa:16:3e:43:30:1d"/>
Nov 07 15:56:15 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:56:15 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 15:56:15 user nova-compute[75018]:       <target dev="tap679c8723-2d"/>
Nov 07 15:56:15 user nova-compute[75018]:     </interface>
Nov 07 15:56:15 user nova-compute[75018]:     <serial type="pty">
Nov 07 15:56:15 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/console.log" append="off"/>
Nov 07 15:56:15 user nova-compute[75018]:     </serial>
Nov 07 15:56:15 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 15:56:15 user nova-compute[75018]:     <video>
Nov 07 15:56:15 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 15:56:15 user nova-compute[75018]:     </video>
Nov 07 15:56:15 user nova-compute[75018]:     <rng model="virtio">
Nov 07 15:56:15 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 15:56:15 user nova-compute[75018]:     </rng>
Nov 07 15:56:15 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 15:56:15 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 15:56:15 user nova-compute[75018]:       <stats period="10"/>
Nov 07 15:56:15 user nova-compute[75018]:     </memballoon>
Nov 07 15:56:15 user nova-compute[75018]:   </devices>
Nov 07 15:56:15 user nova-compute[75018]: </domain>
Nov 07 15:56:15 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1011584129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1011584129',id=46,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b703f914a00c4d5399fbd2a05d855e20',ramdisk_id='',reservation_id='r-ca83hunm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T15:56:14Z,user_data=None,user_id='b85e59486dda47eeb7b0cf5ddf732ecf',uuid=37a43352-eebc-4cea-84c7-0a337e7f9063,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "679c8723-2d01-42eb-b7f7-0a766b635f98", "address": "fa:16:3e:43:30:1d", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c8723-2d", "ovs_interfaceid": "679c8723-2d01-42eb-b7f7-0a766b635f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converting VIF {"id": "679c8723-2d01-42eb-b7f7-0a766b635f98", "address": "fa:16:3e:43:30:1d", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c8723-2d", "ovs_interfaceid": "679c8723-2d01-42eb-b7f7-0a766b635f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:30:1d,bridge_name='br-int',has_traffic_filtering=True,id=679c8723-2d01-42eb-b7f7-0a766b635f98,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679c8723-2d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG os_vif [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:30:1d,bridge_name='br-int',has_traffic_filtering=True,id=679c8723-2d01-42eb-b7f7-0a766b635f98,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679c8723-2d') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '664e83ad-6603-52e3-aaf9-6aef239c6595', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap679c8723-2d, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap679c8723-2d, col_values=(('qos', UUID('09b30b08-ce86-4cc6-bdac-5fc564c41e3d')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap679c8723-2d, col_values=(('external_ids', {'iface-id': '679c8723-2d01-42eb-b7f7-0a766b635f98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:30:1d', 'vm-uuid': '37a43352-eebc-4cea-84c7-0a337e7f9063'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:15 user nova-compute[75018]: INFO os_vif [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:30:1d,bridge_name='br-int',has_traffic_filtering=True,id=679c8723-2d01-42eb-b7f7-0a766b635f98,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679c8723-2d')
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] No VIF found with MAC fa:16:3e:43:30:1d, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.network.neutron [req-ed169729-e2d9-430c-ab13-3c23ea702fd8 req-bf747022-ec17-4b0c-952f-e074db471b54 service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Updated VIF entry in instance network info cache for port 679c8723-2d01-42eb-b7f7-0a766b635f98. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:56:15 user nova-compute[75018]: DEBUG nova.network.neutron [req-ed169729-e2d9-430c-ab13-3c23ea702fd8 req-bf747022-ec17-4b0c-952f-e074db471b54 service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Updating instance_info_cache with network_info: [{"id": "679c8723-2d01-42eb-b7f7-0a766b635f98", "address": "fa:16:3e:43:30:1d", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c8723-2d", "ovs_interfaceid": "679c8723-2d01-42eb-b7f7-0a766b635f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:56:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ed169729-e2d9-430c-ab13-3c23ea702fd8 req-bf747022-ec17-4b0c-952f-e074db471b54 service nova] Releasing lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:56:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:17 user nova-compute[75018]: DEBUG nova.compute.manager [req-e1da7c7f-5e8d-4e5f-bec6-44d5f55c8495 req-581b8565-8bde-40b5-a66c-9f1c10b2bcf1 service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Received event network-vif-plugged-679c8723-2d01-42eb-b7f7-0a766b635f98 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:56:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e1da7c7f-5e8d-4e5f-bec6-44d5f55c8495 req-581b8565-8bde-40b5-a66c-9f1c10b2bcf1 service nova] Acquiring lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:56:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e1da7c7f-5e8d-4e5f-bec6-44d5f55c8495 req-581b8565-8bde-40b5-a66c-9f1c10b2bcf1 service nova] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:56:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e1da7c7f-5e8d-4e5f-bec6-44d5f55c8495 req-581b8565-8bde-40b5-a66c-9f1c10b2bcf1 service nova] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:56:17 user nova-compute[75018]: DEBUG nova.compute.manager [req-e1da7c7f-5e8d-4e5f-bec6-44d5f55c8495 req-581b8565-8bde-40b5-a66c-9f1c10b2bcf1 service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] No waiting events found dispatching network-vif-plugged-679c8723-2d01-42eb-b7f7-0a766b635f98 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:56:17 user nova-compute[75018]: WARNING nova.compute.manager [req-e1da7c7f-5e8d-4e5f-bec6-44d5f55c8495 req-581b8565-8bde-40b5-a66c-9f1c10b2bcf1 service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Received unexpected event network-vif-plugged-679c8723-2d01-42eb-b7f7-0a766b635f98 for instance with vm_state building and task_state spawning.
Nov 07 15:56:19 user nova-compute[75018]: DEBUG nova.compute.manager [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 15:56:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 15:56:19 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Instance spawned successfully.
Nov 07 15:56:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 15:56:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:56:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:56:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:56:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:56:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:56:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 15:56:19 user nova-compute[75018]: INFO nova.compute.manager [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 07 15:56:19 user nova-compute[75018]: DEBUG nova.compute.manager [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:56:19 user nova-compute[75018]: INFO nova.compute.manager [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Took 5.86 seconds to build instance.
Nov 07 15:56:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-db85dafd-7454-4160-8155-9e6ec9628eb7 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.982s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:56:19 user nova-compute[75018]: DEBUG nova.compute.manager [req-957cf03c-b45d-4139-a25a-aa81631c3417 req-3d5c8f13-0eff-4e65-84de-c6c0a2ea8429 service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Received event network-vif-plugged-679c8723-2d01-42eb-b7f7-0a766b635f98 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:56:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-957cf03c-b45d-4139-a25a-aa81631c3417 req-3d5c8f13-0eff-4e65-84de-c6c0a2ea8429 service nova] Acquiring lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:56:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-957cf03c-b45d-4139-a25a-aa81631c3417 req-3d5c8f13-0eff-4e65-84de-c6c0a2ea8429 service nova] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:56:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-957cf03c-b45d-4139-a25a-aa81631c3417 req-3d5c8f13-0eff-4e65-84de-c6c0a2ea8429 service nova] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:56:19 user nova-compute[75018]: DEBUG nova.compute.manager [req-957cf03c-b45d-4139-a25a-aa81631c3417 req-3d5c8f13-0eff-4e65-84de-c6c0a2ea8429 service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] No waiting events found dispatching network-vif-plugged-679c8723-2d01-42eb-b7f7-0a766b635f98 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:56:19 user nova-compute[75018]: WARNING nova.compute.manager [req-957cf03c-b45d-4139-a25a-aa81631c3417 req-3d5c8f13-0eff-4e65-84de-c6c0a2ea8429 service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Received unexpected event network-vif-plugged-679c8723-2d01-42eb-b7f7-0a766b635f98 for instance with vm_state active and task_state None.
Nov 07 15:56:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:41 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:56:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:43 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:56:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 15:56:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] There are 0 instances to clean {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 15:56:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:46 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:56:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:56:49 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:56:49 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:56:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:51 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:56:51 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:56:52 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:56:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:56:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 15:56:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:56:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:56:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:56:52 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid 8e787e6f-2844-4407-ba44-a60b5830cdab {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:56:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updating instance_info_cache with network_info: [{"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:56:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:56:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:56:53 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:56:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75018) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 15:56:54 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:56:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-9e16a778-095d-4f55-a0ea-8cdff835f3b7 req-183e85ab-5ff6-4050-b3e4-98961b510b4d service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-changed-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:56:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-9e16a778-095d-4f55-a0ea-8cdff835f3b7 req-183e85ab-5ff6-4050-b3e4-98961b510b4d service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Refreshing instance network info cache due to event network-changed-1076a216-6e7e-4f2f-b36e-ecb712d3a509. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:56:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9e16a778-095d-4f55-a0ea-8cdff835f3b7 req-183e85ab-5ff6-4050-b3e4-98961b510b4d service nova] Acquiring lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:56:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9e16a778-095d-4f55-a0ea-8cdff835f3b7 req-183e85ab-5ff6-4050-b3e4-98961b510b4d service nova] Acquired lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:56:55 user nova-compute[75018]: DEBUG nova.network.neutron [req-9e16a778-095d-4f55-a0ea-8cdff835f3b7 req-183e85ab-5ff6-4050-b3e4-98961b510b4d service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Refreshing network info cache for port 1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:56:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:56 user nova-compute[75018]: DEBUG nova.network.neutron [req-9e16a778-095d-4f55-a0ea-8cdff835f3b7 req-183e85ab-5ff6-4050-b3e4-98961b510b4d service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updated VIF entry in instance network info cache for port 1076a216-6e7e-4f2f-b36e-ecb712d3a509. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:56:56 user nova-compute[75018]: DEBUG nova.network.neutron [req-9e16a778-095d-4f55-a0ea-8cdff835f3b7 req-183e85ab-5ff6-4050-b3e4-98961b510b4d service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updating instance_info_cache with network_info: [{"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:56:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-9e16a778-095d-4f55-a0ea-8cdff835f3b7 req-183e85ab-5ff6-4050-b3e4-98961b510b4d service nova] Releasing lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:56:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:56:56 user nova-compute[75018]: DEBUG nova.compute.manager [req-450bc4bd-8fc6-460f-9d4c-507b434489ce req-6d016027-0db7-4277-b896-da894c0c2e98 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-changed-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:56:56 user nova-compute[75018]: DEBUG nova.compute.manager [req-450bc4bd-8fc6-460f-9d4c-507b434489ce req-6d016027-0db7-4277-b896-da894c0c2e98 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Refreshing instance network info cache due to event network-changed-1076a216-6e7e-4f2f-b36e-ecb712d3a509. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 15:56:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-450bc4bd-8fc6-460f-9d4c-507b434489ce req-6d016027-0db7-4277-b896-da894c0c2e98 service nova] Acquiring lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:56:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-450bc4bd-8fc6-460f-9d4c-507b434489ce req-6d016027-0db7-4277-b896-da894c0c2e98 service nova] Acquired lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:56:56 user nova-compute[75018]: DEBUG nova.network.neutron [req-450bc4bd-8fc6-460f-9d4c-507b434489ce req-6d016027-0db7-4277-b896-da894c0c2e98 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Refreshing network info cache for port 1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 15:56:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:56:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:56:57 user nova-compute[75018]: INFO nova.compute.manager [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Detaching volume 2ebff817-d13c-4fbc-9084-05dcedede24f
Nov 07 15:56:57 user nova-compute[75018]: INFO nova.virt.block_device [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Attempting to driver detach volume 2ebff817-d13c-4fbc-9084-05dcedede24f from mountpoint /dev/vdb
Nov 07 15:56:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Attempting to detach device vdb from instance bd1bd30b-90d6-4625-b47f-b84441f9fb26 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 15:56:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:56:57 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:56:57 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:56:57 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:56:57 user nova-compute[75018]:   <serial>2ebff817-d13c-4fbc-9084-05dcedede24f</serial>
Nov 07 15:56:57 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:56:57 user nova-compute[75018]: </disk>
Nov 07 15:56:57 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:56:57 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Successfully detached device vdb from instance bd1bd30b-90d6-4625-b47f-b84441f9fb26 from the persistent domain config.
Nov 07 15:56:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd1bd30b-90d6-4625-b47f-b84441f9fb26 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 15:56:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 15:56:57 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 15:56:57 user nova-compute[75018]:   <source dev="/dev/sdc"/>
Nov 07 15:56:57 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 15:56:57 user nova-compute[75018]:   <serial>2ebff817-d13c-4fbc-9084-05dcedede24f</serial>
Nov 07 15:56:57 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 15:56:57 user nova-compute[75018]: </disk>
Nov 07 15:56:57 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 15:56:57 user nova-compute[75018]: DEBUG nova.network.neutron [req-450bc4bd-8fc6-460f-9d4c-507b434489ce req-6d016027-0db7-4277-b896-da894c0c2e98 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updated VIF entry in instance network info cache for port 1076a216-6e7e-4f2f-b36e-ecb712d3a509. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 15:56:57 user nova-compute[75018]: DEBUG nova.network.neutron [req-450bc4bd-8fc6-460f-9d4c-507b434489ce req-6d016027-0db7-4277-b896-da894c0c2e98 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updating instance_info_cache with network_info: [{"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:56:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-450bc4bd-8fc6-460f-9d4c-507b434489ce req-6d016027-0db7-4277-b896-da894c0c2e98 service nova] Releasing lock "refresh_cache-bd1bd30b-90d6-4625-b47f-b84441f9fb26" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:56:57 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd1bd30b-90d6-4625-b47f-b84441f9fb26 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 15:56:58 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:56:59 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:56:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:56:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:56:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:56:59 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:56:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:56:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:56:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:57:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:01 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:57:01 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8686MB free_disk=24.754600524902344GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance bd1bd30b-90d6-4625-b47f-b84441f9fb26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 37a43352-eebc-4cea-84c7-0a337e7f9063 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing inventories for resource provider 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating ProviderTree inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing aggregate associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, aggregates: None {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing trait associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:57:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:57:02 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:57:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:57:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:57:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:57:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:17 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bd1bd30b-90d6-4625-b47f-b84441f9fb26 is timed out.
Nov 07 15:57:17 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Successfully detached device vdb from instance bd1bd30b-90d6-4625-b47f-b84441f9fb26 from the live domain config.
Nov 07 15:57:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLMShYPi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 15:57:17 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0868b7-e8e7-457b-a210-7133567b4aa2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 15:57:17 user nova-compute[75018]: No targets found.
Nov 07 15:57:17 user nova-compute[75018]: iSNS:
Nov 07 15:57:17 user nova-compute[75018]: No targets found.
Nov 07 15:57:17 user nova-compute[75018]: STATIC:
Nov 07 15:57:17 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f
Nov 07 15:57:17 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:57:17 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:57:17 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9
Nov 07 15:57:17 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 15:57:17 user nova-compute[75018]:                 Iface Name: default
Nov 07 15:57:17 user nova-compute[75018]: FIRMWARE:
Nov 07 15:57:17 user nova-compute[75018]: No targets found.
Nov 07 15:57:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 15:57:17 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 15:57:17 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d785e64e-723d-4a50-8df6-505d2410349d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4c6171-e573-480a-b487-1e66ad17b97f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:57:17 user nova-compute[75018]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f (non-flash)
Nov 07 15:57:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 15:57:17 user nova-compute[75018]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f (non-flash)
Nov 07 15:57:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb001f9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f'): ({'sdc'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Removing single pathed devices sdc {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[838ee661-8654-46c3-b0b0-f33aa9334607]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[405f6988-56cc-427b-9865-a6043642f6f3]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Flushing IO for device /dev/sdc {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde5fc2e-d72a-4164-8dd0-3cc2ff8e775a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[90085d6d-197d-4869-9185-fa3bbfbcb783]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6f07a3-8938-4a3a-baee-7368047cb958]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabb9286-f2c5-4ed2-a650-7b0fdf67002b]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f, portal: 172.16.0.220,3260]
Nov 07 15:57:17 user nova-compute[75018]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f, portal: 172.16.0.220,3260] successful.
Nov 07 15:57:17 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ebff817-d13c-4fbc-9084-05dcedede24f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4f1489-8152-4700-b618-04852b7a76e8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] <== disconnect_volume: return (292ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 15:57:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 15:57:18 user nova-compute[75018]: DEBUG nova.objects.instance [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'flavor' on Instance uuid bd1bd30b-90d6-4625-b47f-b84441f9fb26 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:57:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-86b80ed6-8a4d-438d-931d-3b4ac1fecd7a tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.732s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:57:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:57:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:57:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:57:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:57:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:42 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:57:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:57:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:57:49 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:57:49 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:57:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:57:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:51 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:57:51 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:57:52 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:57:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:57:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:57:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:57:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:57:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updating instance_info_cache with network_info: [{"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:57:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:57:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:57:55 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:57:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:57:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:57:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:57:58 user nova-compute[75018]: INFO nova.compute.manager [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Terminating instance
Nov 07 15:57:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-fad08fe1-da7c-4c9a-a30e-9d6ad0c268fd req-85338d2d-a62a-463c-9b5b-8d7b0ae9ad51 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-vif-unplugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fad08fe1-da7c-4c9a-a30e-9d6ad0c268fd req-85338d2d-a62a-463c-9b5b-8d7b0ae9ad51 service nova] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fad08fe1-da7c-4c9a-a30e-9d6ad0c268fd req-85338d2d-a62a-463c-9b5b-8d7b0ae9ad51 service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fad08fe1-da7c-4c9a-a30e-9d6ad0c268fd req-85338d2d-a62a-463c-9b5b-8d7b0ae9ad51 service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-fad08fe1-da7c-4c9a-a30e-9d6ad0c268fd req-85338d2d-a62a-463c-9b5b-8d7b0ae9ad51 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] No waiting events found dispatching network-vif-unplugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG nova.compute.manager [req-fad08fe1-da7c-4c9a-a30e-9d6ad0c268fd req-85338d2d-a62a-463c-9b5b-8d7b0ae9ad51 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-vif-unplugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 15:57:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:59 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Instance destroyed successfully.
Nov 07 15:57:59 user nova-compute[75018]: DEBUG nova.objects.instance [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lazy-loading 'resources' on Instance uuid bd1bd30b-90d6-4625-b47f-b84441f9fb26 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-48748734',display_name='tempest-TestMinimumBasicScenario-server-48748734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-48748734',id=45,image_ref='5dd33011-f3aa-4c13-9516-b9d204cf2acd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM177KbzSVqGPmKKMaocBIZVFMcB2d/EMs3wCzIH8khblWthttN7YIW70SV3K2uPu0EX4yIysKf7pqxmjwJ29uf8BmH8FLUN9E7rnlPitRt0R8o2SSOky//CBy8kCmrawA==',key_name='tempest-TestMinimumBasicScenario-556187429',keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:52:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e9055a2f9df4fc1867db5de885f5430',ramdisk_id='',reservation_id='r-9kwn2qyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5dd33011-f3aa-4c13-9516-b9d204cf2acd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-376924718',owner_user_name='tempest-TestMinimumBasicScenario-376924718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:55:10Z,user_data=None,user_id='d4927e184ba449c493a60d9580755235',uuid=bd1bd30b-90d6-4625-b47f-b84441f9fb26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converting VIF {"id": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "address": "fa:16:3e:f6:da:57", "network": {"id": "85ee9937-a9bd-4f09-9730-f04854be62df", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1399777772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e9055a2f9df4fc1867db5de885f5430", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1076a216-6e", "ovs_interfaceid": "1076a216-6e7e-4f2f-b36e-ecb712d3a509", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:da:57,bridge_name='br-int',has_traffic_filtering=True,id=1076a216-6e7e-4f2f-b36e-ecb712d3a509,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1076a216-6e') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG os_vif [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:da:57,bridge_name='br-int',has_traffic_filtering=True,id=1076a216-6e7e-4f2f-b36e-ecb712d3a509,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1076a216-6e') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1076a216-6e, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47a0f1b0-1b5d-49a8-98b7-c3d883fa23e3) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:57:59 user nova-compute[75018]: INFO os_vif [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:da:57,bridge_name='br-int',has_traffic_filtering=True,id=1076a216-6e7e-4f2f-b36e-ecb712d3a509,network=Network(85ee9937-a9bd-4f09-9730-f04854be62df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1076a216-6e')
Nov 07 15:57:59 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Deleting instance files /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26_del
Nov 07 15:57:59 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Deletion of /opt/stack/data/nova/instances/bd1bd30b-90d6-4625-b47f-b84441f9fb26_del complete
Nov 07 15:57:59 user nova-compute[75018]: INFO nova.compute.manager [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 07 15:57:59 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:57:59 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Took 0.56 seconds to deallocate network for instance.
Nov 07 15:57:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-8732d905-ceeb-4e1d-afe6-6e8a94390df9 req-bb48e04d-c3c7-47ee-9dfd-10211f043926 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-vif-deleted-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:57:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:58:00 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Deleted allocations for instance bd1bd30b-90d6-4625-b47f-b84441f9fb26
Nov 07 15:58:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-307b5d16-ceee-41ae-8473-54c6b138f27b tempest-TestMinimumBasicScenario-376924718 tempest-TestMinimumBasicScenario-376924718-project-member] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.868s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-013c0bc8-1a2c-4d64-a2cf-5fcf09813852 req-128f914f-4fd3-4164-ac0f-43e610511a96 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received event network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-013c0bc8-1a2c-4d64-a2cf-5fcf09813852 req-128f914f-4fd3-4164-ac0f-43e610511a96 service nova] Acquiring lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-013c0bc8-1a2c-4d64-a2cf-5fcf09813852 req-128f914f-4fd3-4164-ac0f-43e610511a96 service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-013c0bc8-1a2c-4d64-a2cf-5fcf09813852 req-128f914f-4fd3-4164-ac0f-43e610511a96 service nova] Lock "bd1bd30b-90d6-4625-b47f-b84441f9fb26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-013c0bc8-1a2c-4d64-a2cf-5fcf09813852 req-128f914f-4fd3-4164-ac0f-43e610511a96 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] No waiting events found dispatching network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 15:58:00 user nova-compute[75018]: WARNING nova.compute.manager [req-013c0bc8-1a2c-4d64-a2cf-5fcf09813852 req-128f914f-4fd3-4164-ac0f-43e610511a96 service nova] [instance: bd1bd30b-90d6-4625-b47f-b84441f9fb26] Received unexpected event network-vif-plugged-1076a216-6e7e-4f2f-b36e-ecb712d3a509 for instance with vm_state deleted and task_state None.
Nov 07 15:58:00 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:58:00 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:58:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=24.781780242919922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 37a43352-eebc-4cea-84c7-0a337e7f9063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:58:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:58:01 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:58:01 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:58:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:58:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:58:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:58:04 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 15:58:04 user nova-compute[75018]: INFO nova.compute.manager [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] instance snapshotting
Nov 07 15:58:04 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Beginning live snapshot process
Nov 07 15:58:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json -f qcow2 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:58:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:58:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json -f qcow2 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:58:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:58:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:58:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.178s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:58:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjl8dryop/e240ed50a68141ed84618b9fc915a4f3.delta 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:58:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjl8dryop/e240ed50a68141ed84618b9fc915a4f3.delta 1073741824" returned: 0 in 0.047s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:58:05 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 07 15:58:05 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75018) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 15:58:06 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75018) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 15:58:06 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 07 15:58:06 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 15:58:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjl8dryop/e240ed50a68141ed84618b9fc915a4f3.delta /opt/stack/data/nova/instances/snapshots/tmpjl8dryop/e240ed50a68141ed84618b9fc915a4f3 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:58:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjl8dryop/e240ed50a68141ed84618b9fc915a4f3.delta /opt/stack/data/nova/instances/snapshots/tmpjl8dryop/e240ed50a68141ed84618b9fc915a4f3" returned: 0 in 0.344s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:58:06 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Snapshot extracted, beginning image upload
Nov 07 15:58:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:58:09 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Snapshot image upload complete
Nov 07 15:58:09 user nova-compute[75018]: INFO nova.compute.manager [None req-1f2a32ed-50d9-49ad-ad08-ef410e0cde30 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Took 5.10 seconds to snapshot the instance on the hypervisor.
Nov 07 15:58:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:58:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:58:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 15:58:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:58:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 15:58:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:58:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:58:21 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:58:21 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 8e787e6f-2844-4407-ba44-a60b5830cdab {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:58:21 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid fa037da8-53d1-4dcd-9478-59a9e9cfb726 {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:58:21 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid 37a43352-eebc-4cea-84c7-0a337e7f9063 {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 15:58:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "8e787e6f-2844-4407-ba44-a60b5830cdab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:58:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:58:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:58:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:58:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "37a43352-eebc-4cea-84c7-0a337e7f9063" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:58:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:58:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:58:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:58:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:58:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:58:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:58:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:58:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:58:43 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:58:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:58:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:58:48 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:58:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:58:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:58:50 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:58:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:58:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:58:52 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:58:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:58:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:58:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:58:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:58:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Updating instance_info_cache with network_info: [{"id": "679c8723-2d01-42eb-b7f7-0a766b635f98", "address": "fa:16:3e:43:30:1d", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c8723-2d", "ovs_interfaceid": "679c8723-2d01-42eb-b7f7-0a766b635f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:58:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:58:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:58:53 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:58:53 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:58:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:58:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:58:56 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:58:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:58:59 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:58:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:58:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:58:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:58:59 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 15:58:59 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 15:58:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:58:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:58:59 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:59:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:59:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:59:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:59:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 15:59:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 15:59:00 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:59:00 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 15:59:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8857MB free_disk=24.771587371826172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 15:59:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 15:59:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 15:59:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:59:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:59:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 37a43352-eebc-4cea-84c7-0a337e7f9063 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 15:59:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 15:59:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 15:59:01 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 15:59:01 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 15:59:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 15:59:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 15:59:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:59:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:59:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:59:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:59:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:59:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:59:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:59:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:59:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 15:59:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:59:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:59:48 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:59:48 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:59:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:59:50 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:59:50 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 15:59:52 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:59:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 15:59:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 15:59:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 15:59:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 15:59:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 15:59:52 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid 8e787e6f-2844-4407-ba44-a60b5830cdab {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 15:59:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updating instance_info_cache with network_info: [{"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 15:59:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 15:59:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 15:59:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 15:59:54 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:59:54 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:59:56 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 15:59:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:00:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:00:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:00:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:00:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:00:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:00:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:00:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:00:01 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:00:01 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:00:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=24.771007537841797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 37a43352-eebc-4cea-84c7-0a337e7f9063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 75284cef-c065-4f26-80fb-10cf9347cb8b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:00:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:00:02 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:00:02 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:00:02 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:00:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:00:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.177s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:00:02 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 16:00:02 user nova-compute[75018]: INFO nova.compute.claims [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Claim successful on node user
Nov 07 16:00:02 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:00:02 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:00:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:00:02 user nova-compute[75018]: DEBUG nova.compute.manager [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 16:00:02 user nova-compute[75018]: DEBUG nova.compute.manager [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 16:00:02 user nova-compute[75018]: DEBUG nova.network.neutron [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 16:00:02 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 16:00:02 user nova-compute[75018]: DEBUG nova.compute.manager [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 16:00:02 user nova-compute[75018]: DEBUG nova.policy [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b85e59486dda47eeb7b0cf5ddf732ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b703f914a00c4d5399fbd2a05d855e20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 16:00:02 user nova-compute[75018]: INFO nova.virt.block_device [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Booting with volume-backed-image 667dc137-8627-496e-9a1f-9f5738befeda at /dev/vda
Nov 07 16:00:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:03 user nova-compute[75018]: DEBUG nova.network.neutron [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Successfully created port: 70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 16:00:03 user nova-compute[75018]: DEBUG nova.network.neutron [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Successfully updated port: 70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 16:00:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "refresh_cache-75284cef-c065-4f26-80fb-10cf9347cb8b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:00:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquired lock "refresh_cache-75284cef-c065-4f26-80fb-10cf9347cb8b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:00:03 user nova-compute[75018]: DEBUG nova.network.neutron [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 16:00:04 user nova-compute[75018]: DEBUG nova.compute.manager [req-c9bbc7fa-866f-4a83-a7a6-ca646a7fd8be req-7ac6edb1-eb52-4b98-99be-08b7ac31a2aa service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-changed-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:00:04 user nova-compute[75018]: DEBUG nova.compute.manager [req-c9bbc7fa-866f-4a83-a7a6-ca646a7fd8be req-7ac6edb1-eb52-4b98-99be-08b7ac31a2aa service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Refreshing instance network info cache due to event network-changed-70ac5c7e-5ca6-4c62-b2e9-195e41895453. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 16:00:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c9bbc7fa-866f-4a83-a7a6-ca646a7fd8be req-7ac6edb1-eb52-4b98-99be-08b7ac31a2aa service nova] Acquiring lock "refresh_cache-75284cef-c065-4f26-80fb-10cf9347cb8b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:00:04 user nova-compute[75018]: DEBUG nova.network.neutron [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 16:00:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:04 user nova-compute[75018]: DEBUG nova.network.neutron [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Updating instance_info_cache with network_info: [{"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:00:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Releasing lock "refresh_cache-75284cef-c065-4f26-80fb-10cf9347cb8b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:00:04 user nova-compute[75018]: DEBUG nova.compute.manager [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Instance network_info: |[{"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 16:00:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c9bbc7fa-866f-4a83-a7a6-ca646a7fd8be req-7ac6edb1-eb52-4b98-99be-08b7ac31a2aa service nova] Acquired lock "refresh_cache-75284cef-c065-4f26-80fb-10cf9347cb8b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:00:04 user nova-compute[75018]: DEBUG nova.network.neutron [req-c9bbc7fa-866f-4a83-a7a6-ca646a7fd8be req-7ac6edb1-eb52-4b98-99be-08b7ac31a2aa service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Refreshing network info cache for port 70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 16:00:05 user nova-compute[75018]: DEBUG nova.network.neutron [req-c9bbc7fa-866f-4a83-a7a6-ca646a7fd8be req-7ac6edb1-eb52-4b98-99be-08b7ac31a2aa service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Updated VIF entry in instance network info cache for port 70ac5c7e-5ca6-4c62-b2e9-195e41895453. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 16:00:05 user nova-compute[75018]: DEBUG nova.network.neutron [req-c9bbc7fa-866f-4a83-a7a6-ca646a7fd8be req-7ac6edb1-eb52-4b98-99be-08b7ac31a2aa service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Updating instance_info_cache with network_info: [{"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:00:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c9bbc7fa-866f-4a83-a7a6-ca646a7fd8be req-7ac6edb1-eb52-4b98-99be-08b7ac31a2aa service nova] Releasing lock "refresh_cache-75284cef-c065-4f26-80fb-10cf9347cb8b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:00:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG os_brick.utils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d26915-7a9d-4749-9749-592d3b12a4df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4ecd47-aee9-4732-806f-b17ded04c489]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ae92eb-3edd-4297-adda-050f12941977]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c001d27-c3bb-4ac4-8acb-dd613a64dc33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 16:00:18 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 16:00:18 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81c5ddb-e53f-44cd-9dec-c244b6463bfe]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG os_brick.utils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 16:00:18 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Updating existing volume attachment record: 12ec82f1-cd6a-4a8f-b973-c859fbda36ee {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 16:00:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:00:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:00:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:00:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.compute.manager [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 16:00:39 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Creating image(s)
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Did not create local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Ensure instance console log exists: /opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Start _get_guest_xml network_info=[{"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcvUsjzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '75284cef-c065-4f26-80fb-10cf9347cb8b', 'attached_at': '', 'detached_at': '', 'volume_id': '1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e', 'serial': '1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '12ec82f1-cd6a-4a8f-b973-c859fbda36ee', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 16:00:39 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:00:39 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcvUsjzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 16:00:39 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:00:39 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:00:39 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9fdee0-6469-414a-970b-654d5c11c1eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 16:00:39 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5018ae-6f36-4a7e-a3a9-87784af959bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e] added
Nov 07 16:00:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[069b9626-f836-485b-a6c9-06e149e16307]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12971ed-5d74-4dac-835e-e06e2ac2b119]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcvUsjzR {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcvUsjzR" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c14808-7b64-41b3-98c9-5bc6d00b612a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xcvUsjzR'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ad2018-ebe8-44da-a567-26c9490a71f6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[807cf190-90a2-4a40-87ad-f2a875e2931e]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 16:00:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 16:00:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccc3f71-0360-4f26-9815-1d9f46dd2a04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e, portal: 172.16.0.220,3260]
Nov 07 16:00:39 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e, portal: 172.16.0.220,3260] successful.
Nov 07 16:00:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f535acb-2439-46eb-848d-ddb8d85525d2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[016da03f-d96b-4193-a456-c54cfa2c02f0]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 16:00:39 user nova-compute[75018]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e (non-flash)
Nov 07 16:00:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 16:00:39 user nova-compute[75018]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e (non-flash)
Nov 07 16:00:39 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74da43d-15c7-49c3-926e-08ae460b7877]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:00:39 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcvUsjzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26464303465353162', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464303465353162', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:00:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-444402787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-444402787',id=47,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b703f914a00c4d5399fbd2a05d855e20',ramdisk_id='',reservation_id='r-581aiyf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T16:00:03Z,user_data=None,user_id='b85e59486dda47eeb7b0cf5ddf732ecf',uuid=75284cef-c065-4f26-80fb-10cf9347cb8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converting VIF {"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:e7:3b,bridge_name='br-int',has_traffic_filtering=True,id=70ac5c7e-5ca6-4c62-b2e9-195e41895453,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ac5c7e-5c') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'pci_devices' on Instance uuid 75284cef-c065-4f26-80fb-10cf9347cb8b {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] End _get_guest_xml xml=<domain type="kvm">
Nov 07 16:00:40 user nova-compute[75018]:   <uuid>75284cef-c065-4f26-80fb-10cf9347cb8b</uuid>
Nov 07 16:00:40 user nova-compute[75018]:   <name>instance-0000002f</name>
Nov 07 16:00:40 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 16:00:40 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 16:00:40 user nova-compute[75018]:   <metadata>
Nov 07 16:00:40 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 16:00:40 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 16:00:40 user nova-compute[75018]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-444402787</nova:name>
Nov 07 16:00:40 user nova-compute[75018]:       <nova:creationTime>2023-11-07 16:00:39</nova:creationTime>
Nov 07 16:00:40 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 16:00:40 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 16:00:40 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 16:00:40 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 16:00:40 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 16:00:40 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 16:00:40 user nova-compute[75018]:       </nova:flavor>
Nov 07 16:00:40 user nova-compute[75018]:       <nova:owner>
Nov 07 16:00:40 user nova-compute[75018]:         <nova:user uuid="b85e59486dda47eeb7b0cf5ddf732ecf">tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member</nova:user>
Nov 07 16:00:40 user nova-compute[75018]:         <nova:project uuid="b703f914a00c4d5399fbd2a05d855e20">tempest-ServerBootFromVolumeStableRescueTest-1314994176</nova:project>
Nov 07 16:00:40 user nova-compute[75018]:       </nova:owner>
Nov 07 16:00:40 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 16:00:40 user nova-compute[75018]:       <nova:ports>
Nov 07 16:00:40 user nova-compute[75018]:         <nova:port uuid="70ac5c7e-5ca6-4c62-b2e9-195e41895453">
Nov 07 16:00:40 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 07 16:00:40 user nova-compute[75018]:         </nova:port>
Nov 07 16:00:40 user nova-compute[75018]:       </nova:ports>
Nov 07 16:00:40 user nova-compute[75018]:     </nova:instance>
Nov 07 16:00:40 user nova-compute[75018]:   </metadata>
Nov 07 16:00:40 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 16:00:40 user nova-compute[75018]:     <system>
Nov 07 16:00:40 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 16:00:40 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 16:00:40 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 16:00:40 user nova-compute[75018]:       <entry name="serial">75284cef-c065-4f26-80fb-10cf9347cb8b</entry>
Nov 07 16:00:40 user nova-compute[75018]:       <entry name="uuid">75284cef-c065-4f26-80fb-10cf9347cb8b</entry>
Nov 07 16:00:40 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 16:00:40 user nova-compute[75018]:     </system>
Nov 07 16:00:40 user nova-compute[75018]:   </sysinfo>
Nov 07 16:00:40 user nova-compute[75018]:   <os>
Nov 07 16:00:40 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 16:00:40 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 16:00:40 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 16:00:40 user nova-compute[75018]:   </os>
Nov 07 16:00:40 user nova-compute[75018]:   <features>
Nov 07 16:00:40 user nova-compute[75018]:     <acpi/>
Nov 07 16:00:40 user nova-compute[75018]:     <apic/>
Nov 07 16:00:40 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 16:00:40 user nova-compute[75018]:   </features>
Nov 07 16:00:40 user nova-compute[75018]:   <clock offset="utc">
Nov 07 16:00:40 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 16:00:40 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 16:00:40 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 16:00:40 user nova-compute[75018]:   </clock>
Nov 07 16:00:40 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 16:00:40 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 16:00:40 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 16:00:40 user nova-compute[75018]:   </cpu>
Nov 07 16:00:40 user nova-compute[75018]:   <devices>
Nov 07 16:00:40 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 16:00:40 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 16:00:40 user nova-compute[75018]:       <source dev="/dev/sdc"/>
Nov 07 16:00:40 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 16:00:40 user nova-compute[75018]:       <serial>1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e</serial>
Nov 07 16:00:40 user nova-compute[75018]:     </disk>
Nov 07 16:00:40 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 16:00:40 user nova-compute[75018]:       <mac address="fa:16:3e:45:e7:3b"/>
Nov 07 16:00:40 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 16:00:40 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 16:00:40 user nova-compute[75018]:       <target dev="tap70ac5c7e-5c"/>
Nov 07 16:00:40 user nova-compute[75018]:     </interface>
Nov 07 16:00:40 user nova-compute[75018]:     <serial type="pty">
Nov 07 16:00:40 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/console.log" append="off"/>
Nov 07 16:00:40 user nova-compute[75018]:     </serial>
Nov 07 16:00:40 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 16:00:40 user nova-compute[75018]:     <video>
Nov 07 16:00:40 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 16:00:40 user nova-compute[75018]:     </video>
Nov 07 16:00:40 user nova-compute[75018]:     <rng model="virtio">
Nov 07 16:00:40 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 16:00:40 user nova-compute[75018]:     </rng>
Nov 07 16:00:40 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 16:00:40 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 16:00:40 user nova-compute[75018]:       <stats period="10"/>
Nov 07 16:00:40 user nova-compute[75018]:     </memballoon>
Nov 07 16:00:40 user nova-compute[75018]:   </devices>
Nov 07 16:00:40 user nova-compute[75018]: </domain>
Nov 07 16:00:40 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:00:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-444402787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-444402787',id=47,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b703f914a00c4d5399fbd2a05d855e20',ramdisk_id='',reservation_id='r-581aiyf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T16:00:03Z,user_data=None,user_id='b85e59486dda47eeb7b0cf5ddf732ecf',uuid=75284cef-c065-4f26-80fb-10cf9347cb8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converting VIF {"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:e7:3b,bridge_name='br-int',has_traffic_filtering=True,id=70ac5c7e-5ca6-4c62-b2e9-195e41895453,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ac5c7e-5c') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG os_vif [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:e7:3b,bridge_name='br-int',has_traffic_filtering=True,id=70ac5c7e-5ca6-4c62-b2e9-195e41895453,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ac5c7e-5c') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af7e16ba-c7c4-51de-a589-5f470c0c9360', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70ac5c7e-5c, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70ac5c7e-5c, col_values=(('qos', UUID('e6c9e07e-0fb2-4ade-b7cc-f9d26bef4f6a')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70ac5c7e-5c, col_values=(('external_ids', {'iface-id': '70ac5c7e-5ca6-4c62-b2e9-195e41895453', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:e7:3b', 'vm-uuid': '75284cef-c065-4f26-80fb-10cf9347cb8b'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:40 user nova-compute[75018]: INFO os_vif [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:e7:3b,bridge_name='br-int',has_traffic_filtering=True,id=70ac5c7e-5ca6-4c62-b2e9-195e41895453,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ac5c7e-5c')
Nov 07 16:00:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 16:00:40 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] No VIF found with MAC fa:16:3e:45:e7:3b, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 16:00:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:42 user nova-compute[75018]: DEBUG nova.compute.manager [req-443f2258-2217-4137-82db-10e9978c4cbf req-575b3e2e-563f-4245-ba17-79a36952eebe service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:00:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-443f2258-2217-4137-82db-10e9978c4cbf req-575b3e2e-563f-4245-ba17-79a36952eebe service nova] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:00:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-443f2258-2217-4137-82db-10e9978c4cbf req-575b3e2e-563f-4245-ba17-79a36952eebe service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:00:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-443f2258-2217-4137-82db-10e9978c4cbf req-575b3e2e-563f-4245-ba17-79a36952eebe service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:00:42 user nova-compute[75018]: DEBUG nova.compute.manager [req-443f2258-2217-4137-82db-10e9978c4cbf req-575b3e2e-563f-4245-ba17-79a36952eebe service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] No waiting events found dispatching network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:00:42 user nova-compute[75018]: WARNING nova.compute.manager [req-443f2258-2217-4137-82db-10e9978c4cbf req-575b3e2e-563f-4245-ba17-79a36952eebe service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received unexpected event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 for instance with vm_state building and task_state spawning.
Nov 07 16:00:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 16:00:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 16:00:43 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Instance spawned successfully.
Nov 07 16:00:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 16:00:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:00:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:00:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:00:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:00:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:00:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:00:44 user nova-compute[75018]: INFO nova.compute.manager [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Took 4.80 seconds to spawn the instance on the hypervisor.
Nov 07 16:00:44 user nova-compute[75018]: DEBUG nova.compute.manager [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 16:00:44 user nova-compute[75018]: INFO nova.compute.manager [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Took 42.19 seconds to build instance.
Nov 07 16:00:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3cc35a74-8d03-4e14-bad1-9448274673c0 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.284s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:00:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-07a4ca2b-925f-4d28-8045-19145515e223 req-7ed4aaaa-5cf1-4a65-88c3-416b209b8cdc service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:00:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-07a4ca2b-925f-4d28-8045-19145515e223 req-7ed4aaaa-5cf1-4a65-88c3-416b209b8cdc service nova] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:00:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-07a4ca2b-925f-4d28-8045-19145515e223 req-7ed4aaaa-5cf1-4a65-88c3-416b209b8cdc service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:00:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-07a4ca2b-925f-4d28-8045-19145515e223 req-7ed4aaaa-5cf1-4a65-88c3-416b209b8cdc service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:00:44 user nova-compute[75018]: DEBUG nova.compute.manager [req-07a4ca2b-925f-4d28-8045-19145515e223 req-7ed4aaaa-5cf1-4a65-88c3-416b209b8cdc service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] No waiting events found dispatching network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:00:44 user nova-compute[75018]: WARNING nova.compute.manager [req-07a4ca2b-925f-4d28-8045-19145515e223 req-7ed4aaaa-5cf1-4a65-88c3-416b209b8cdc service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received unexpected event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 for instance with vm_state active and task_state None.
Nov 07 16:00:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:00:50 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:00:50 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:00:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:51 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:00:51 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:00:53 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:00:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:00:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:00:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:00:53 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:00:54 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updating instance_info_cache with network_info: [{"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:00:54 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:00:54 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:00:54 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:00:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:00:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:00:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:00:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:00:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:00:56 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:00:57 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:01 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:01:01 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:01:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8710MB free_disk=24.769264221191406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 37a43352-eebc-4cea-84c7-0a337e7f9063 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 75284cef-c065-4f26-80fb-10cf9347cb8b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:01:01 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:01:02 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:01:02 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:01:02 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:01:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:01:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:09 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:01:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:01:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:01:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:01:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:01:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:01:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:01:44 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:01:44 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 16:01:44 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] There are 0 instances to clean {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 16:01:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:01:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:01:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:01:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:01:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:46 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:01:50 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:01:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:01:52 user nova-compute[75018]: INFO nova.compute.manager [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Rescuing
Nov 07 16:01:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "refresh_cache-75284cef-c065-4f26-80fb-10cf9347cb8b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:01:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquired lock "refresh_cache-75284cef-c065-4f26-80fb-10cf9347cb8b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:01:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 16:01:52 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:01:52 user nova-compute[75018]: DEBUG nova.network.neutron [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Updating instance_info_cache with network_info: [{"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:01:52 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Releasing lock "refresh_cache-75284cef-c065-4f26-80fb-10cf9347cb8b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:01:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-19df2a32-0b85-4c6a-b0a0-c0b40132a359 req-28ba0aab-deda-4fe3-8f57-dd51ce04771f service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-vif-unplugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-19df2a32-0b85-4c6a-b0a0-c0b40132a359 req-28ba0aab-deda-4fe3-8f57-dd51ce04771f service nova] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-19df2a32-0b85-4c6a-b0a0-c0b40132a359 req-28ba0aab-deda-4fe3-8f57-dd51ce04771f service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-19df2a32-0b85-4c6a-b0a0-c0b40132a359 req-28ba0aab-deda-4fe3-8f57-dd51ce04771f service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG nova.compute.manager [req-19df2a32-0b85-4c6a-b0a0-c0b40132a359 req-28ba0aab-deda-4fe3-8f57-dd51ce04771f service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] No waiting events found dispatching network-vif-unplugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:01:53 user nova-compute[75018]: WARNING nova.compute.manager [req-19df2a32-0b85-4c6a-b0a0-c0b40132a359 req-28ba0aab-deda-4fe3-8f57-dd51ce04771f service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received unexpected event network-vif-unplugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 for instance with vm_state active and task_state rescuing.
Nov 07 16:01:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:01:53 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Instance destroyed successfully.
Nov 07 16:01:53 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Attempting a stable device rescue
Nov 07 16:01:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75018) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Instance directory exists: not creating {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 16:01:53 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Creating image(s)
Nov 07 16:01:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "/opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "/opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "/opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG nova.objects.instance [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'trusted_certs' on Instance uuid 75284cef-c065-4f26-80fb-10cf9347cb8b {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:01:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:01:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4.part --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:54 user nova-compute[75018]: DEBUG nova.virt.images [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] 88ca9330-59d5-47fa-8226-761ea7ab5d2d was qcow2, converting to raw {{(pid=75018) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 16:01:54 user nova-compute[75018]: DEBUG nova.privsep.utils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75018) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 16:01:54 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4.part /opt/stack/data/nova/instances/_base/3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4.converted {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4.part /opt/stack/data/nova/instances/_base/3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4.converted" returned: 0 in 0.300s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4.converted --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-cb9a7904-48ee-4cb6-996d-8fa0c52a622c req-6f64dfaf-00be-4f89-8dc7-4954636ea4c1 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cb9a7904-48ee-4cb6-996d-8fa0c52a622c req-6f64dfaf-00be-4f89-8dc7-4954636ea4c1 service nova] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cb9a7904-48ee-4cb6-996d-8fa0c52a622c req-6f64dfaf-00be-4f89-8dc7-4954636ea4c1 service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cb9a7904-48ee-4cb6-996d-8fa0c52a622c req-6f64dfaf-00be-4f89-8dc7-4954636ea4c1 service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.compute.manager [req-cb9a7904-48ee-4cb6-996d-8fa0c52a622c req-6f64dfaf-00be-4f89-8dc7-4954636ea4c1 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] No waiting events found dispatching network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:01:55 user nova-compute[75018]: WARNING nova.compute.manager [req-cb9a7904-48ee-4cb6-996d-8fa0c52a622c req-6f64dfaf-00be-4f89-8dc7-4954636ea4c1 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received unexpected event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 for instance with vm_state active and task_state rescuing.
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.568s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4 --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4 --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4,backing_fmt=raw /opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/disk.rescue {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4,backing_fmt=raw /opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/disk.rescue" returned: 0 in 0.051s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "3eb42b1bb6e6bd37e4ea25e8ca7f623070ce6db4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'migration_context' on Instance uuid 75284cef-c065-4f26-80fb-10cf9347cb8b {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.objects.base [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Object Instance<75284cef-c065-4f26-80fb-10cf9347cb8b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Start _get_guest_xml network_info=[{"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "vif_mac": "fa:16:3e:45:e7:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '88ca9330-59d5-47fa-8226-761ea7ab5d2d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcvUsjzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '75284cef-c065-4f26-80fb-10cf9347cb8b', 'attached_at': '', 'detached_at': '', 'volume_id': '1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e', 'serial': '1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '12ec82f1-cd6a-4a8f-b973-c859fbda36ee', 'volume_type': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'resources' on Instance uuid 75284cef-c065-4f26-80fb-10cf9347cb8b {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.objects.base [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Object Instance<75284cef-c065-4f26-80fb-10cf9347cb8b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'numa_topology' on Instance uuid 75284cef-c065-4f26-80fb-10cf9347cb8b {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.objects.base [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Object Instance<75284cef-c065-4f26-80fb-10cf9347cb8b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 16:01:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:01:55 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'vcpu_model' on Instance uuid 75284cef-c065-4f26-80fb-10cf9347cb8b {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.objects.base [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Object Instance<75284cef-c065-4f26-80fb-10cf9347cb8b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcvUsjzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 16:01:55 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:01:55 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:01:55 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cda2d43-109d-409b-91cf-dfed4667bffe]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xcvUsjzR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 07 16:01:55 user nova-compute[75018]: node.name = iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e
Nov 07 16:01:55 user nova-compute[75018]: node.tpgt = -1
Nov 07 16:01:55 user nova-compute[75018]: node.startup = automatic
Nov 07 16:01:55 user nova-compute[75018]: node.leading_login = No
Nov 07 16:01:55 user nova-compute[75018]: iface.iscsi_ifacename = default
Nov 07 16:01:55 user nova-compute[75018]: iface.net_ifacename = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.ipaddress = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.prefix_len = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.hwaddress = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.transport_name = tcp
Nov 07 16:01:55 user nova-compute[75018]: iface.initiatorname = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.state = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.vlan_id = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.vlan_priority = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.vlan_state = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.iface_num = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.mtu = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.port = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.bootproto = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.subnet_mask = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.gateway = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.dhcp_alt_client_id_state = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.dhcp_alt_client_id = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.dhcp_dns = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.dhcp_learn_iqn = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.dhcp_req_vendor_id_state = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.dhcp_vendor_id_state = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.dhcp_vendor_id = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.dhcp_slp_da = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.fragmentation = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.gratuitous_arp = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.incoming_forwarding = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.tos_state = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.tos = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.ttl = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.delayed_ack = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.tcp_nagle = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.tcp_wsf_state = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.tcp_wsf = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.tcp_timer_scale = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.tcp_timestamp = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.redirect = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.def_task_mgmt_timeout = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.header_digest = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.data_digest = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.immediate_data = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.initial_r2t = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.data_seq_inorder = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.data_pdu_inorder = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.erl = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.max_receive_data_len = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.first_burst_len = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.max_outstanding_r2t = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.max_burst_len = 0
Nov 07 16:01:55 user nova-compute[75018]: iface.chap_auth = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.bidi_chap = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.strict_login_compliance = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.discovery_auth = <empty>
Nov 07 16:01:55 user nova-compute[75018]: iface.discovery_logout = <empty>
Nov 07 16:01:55 user nova-compute[75018]: node.discovery_address = <empty>
Nov 07 16:01:55 user nova-compute[75018]: node.discovery_port = 0
Nov 07 16:01:55 user nova-compute[75018]: node.discovery_type = static
Nov 07 16:01:55 user nova-compute[75018]: node.session.initial_cmdsn = 0
Nov 07 16:01:55 user nova-compute[75018]: node.session.initial_login_retry_max = 8
Nov 07 16:01:55 user nova-compute[75018]: node.session.xmit_thread_priority = -20
Nov 07 16:01:55 user nova-compute[75018]: node.session.cmds_max = 128
Nov 07 16:01:55 user nova-compute[75018]: node.session.queue_depth = 32
Nov 07 16:01:55 user nova-compute[75018]: node.session.nr_sessions = 1
Nov 07 16:01:55 user nova-compute[75018]: node.session.auth.authmethod = CHAP
Nov 07 16:01:55 user nova-compute[75018]: node.session.auth.username = xcvUsjzR
Nov 07 16:01:55 user nova-compute[75018]: node.session.auth.password = ***
Nov 07 16:01:55 user nova-compute[75018]: node.session.auth.username_in = <empty>
Nov 07 16:01:55 user nova-compute[75018]: node.session.auth.password_in = <empty>
Nov 07 16:01:55 user nova-compute[75018]: node.session.auth.chap_algs = MD5
Nov 07 16:01:55 user nova-compute[75018]: node.session.timeo.replacement_timeout = 120
Nov 07 16:01:55 user nova-compute[75018]: node.session.err_timeo.abort_timeout = 15
Nov 07 16:01:55 user nova-compute[75018]: node.session.err_timeo.lu_reset_timeout = 30
Nov 07 16:01:55 user nova-compute[75018]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 07 16:01:55 user nova-compute[75018]: node.session.err_timeo.host_reset_timeout = 60
Nov 07 16:01:55 user nova-compute[75018]: node.session.iscsi.FastAbort = Yes
Nov 07 16:01:55 user nova-compute[75018]: node.session.iscsi.InitialR2T = No
Nov 07 16:01:55 user nova-compute[75018]: node.session.iscsi.ImmediateData = Yes
Nov 07 16:01:55 user nova-compute[75018]: node.session.iscsi.FirstBurstLength = 262144
Nov 07 16:01:55 user nova-compute[75018]: node.session.iscsi.MaxBurstLength = 16776192
Nov 07 16:01:55 user nova-compute[75018]: node.session.iscsi.DefaultTime2Retain = 0
Nov 07 16:01:55 user nova-compute[75018]: node.session.iscsi.DefaultTime2Wait = 2
Nov 07 16:01:55 user nova-compute[75018]: node.session.iscsi.MaxConnections = 1
Nov 07 16:01:55 user nova-compute[75018]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 07 16:01:55 user nova-compute[75018]: node.session.iscsi.ERL = 0
Nov 07 16:01:55 user nova-compute[75018]: node.session.scan = manual
Nov 07 16:01:55 user nova-compute[75018]: node.session.reopen_max = 0
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].address = 172.16.0.220
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].port = 3260
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].startup = manual
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].tcp.window_size = 524288
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].tcp.type_of_service = 0
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].timeo.logout_timeout = 15
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].timeo.login_timeout = 15
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].timeo.auth_timeout = 45
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].timeo.noop_out_interval = 5
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].timeo.noop_out_timeout = 5
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].iscsi.HeaderDigest = None
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].iscsi.DataDigest = None
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].iscsi.IFMarker = No
Nov 07 16:01:55 user nova-compute[75018]: node.conn[0].iscsi.OFMarker = No
Nov 07 16:01:55 user nova-compute[75018]: # END RECORD
Nov 07 16:01:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ffd25d-e13b-4b34-930e-6265cfd50b5f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e911c88-aa26-4687-88b3-efdc9c53ded4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcvUsjzR {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcvUsjzR" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b166e9-42d5-4e16-ad69-dd535495a88e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xcvUsjzR'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d9534f-3fd0-4472-ad9c-f06daa8eb03e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2000f2d-51ad-433d-b2ed-b5a162253339]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 16:01:55 user nova-compute[75018]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e (non-flash)
Nov 07 16:01:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 16:01:55 user nova-compute[75018]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e (non-flash)
Nov 07 16:01:55 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] HCTL ('34', '0', '0', 0) found on session 55 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[392b9487-d3c0-44fb-9873-d0c74fd4a39f]: (4, ('0 0 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Searching for a device in session 55 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcvUsjzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '26464303465353162', 'path': '/dev/sdc'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464303465353162', 'path': '/dev/sdc'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:00:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-444402787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-444402787',id=47,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T16:00:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b703f914a00c4d5399fbd2a05d855e20',ramdisk_id='',reservation_id='r-581aiyf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T16:00:44Z,user_data=None,user_id='b85e59486dda47eeb7b0cf5ddf732ecf',uuid=75284cef-c065-4f26-80fb-10cf9347cb8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "vif_mac": "fa:16:3e:45:e7:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converting VIF {"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "vif_mac": "fa:16:3e:45:e7:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:e7:3b,bridge_name='br-int',has_traffic_filtering=True,id=70ac5c7e-5ca6-4c62-b2e9-195e41895453,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ac5c7e-5c') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'pci_devices' on Instance uuid 75284cef-c065-4f26-80fb-10cf9347cb8b {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.objects.base [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Object Instance<75284cef-c065-4f26-80fb-10cf9347cb8b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75018) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] End _get_guest_xml xml=<domain type="kvm">
Nov 07 16:01:55 user nova-compute[75018]:   <uuid>75284cef-c065-4f26-80fb-10cf9347cb8b</uuid>
Nov 07 16:01:55 user nova-compute[75018]:   <name>instance-0000002f</name>
Nov 07 16:01:55 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 16:01:55 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 16:01:55 user nova-compute[75018]:   <metadata>
Nov 07 16:01:55 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 16:01:55 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 16:01:55 user nova-compute[75018]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-444402787</nova:name>
Nov 07 16:01:55 user nova-compute[75018]:       <nova:creationTime>2023-11-07 16:01:55</nova:creationTime>
Nov 07 16:01:55 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 16:01:55 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 16:01:55 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 16:01:55 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 16:01:55 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 16:01:55 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 16:01:55 user nova-compute[75018]:       </nova:flavor>
Nov 07 16:01:55 user nova-compute[75018]:       <nova:owner>
Nov 07 16:01:55 user nova-compute[75018]:         <nova:user uuid="b85e59486dda47eeb7b0cf5ddf732ecf">tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member</nova:user>
Nov 07 16:01:55 user nova-compute[75018]:         <nova:project uuid="b703f914a00c4d5399fbd2a05d855e20">tempest-ServerBootFromVolumeStableRescueTest-1314994176</nova:project>
Nov 07 16:01:55 user nova-compute[75018]:       </nova:owner>
Nov 07 16:01:55 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 16:01:55 user nova-compute[75018]:       <nova:ports>
Nov 07 16:01:55 user nova-compute[75018]:         <nova:port uuid="70ac5c7e-5ca6-4c62-b2e9-195e41895453">
Nov 07 16:01:55 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 07 16:01:55 user nova-compute[75018]:         </nova:port>
Nov 07 16:01:55 user nova-compute[75018]:       </nova:ports>
Nov 07 16:01:55 user nova-compute[75018]:     </nova:instance>
Nov 07 16:01:55 user nova-compute[75018]:   </metadata>
Nov 07 16:01:55 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 16:01:55 user nova-compute[75018]:     <system>
Nov 07 16:01:55 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 16:01:55 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 16:01:55 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 16:01:55 user nova-compute[75018]:       <entry name="serial">75284cef-c065-4f26-80fb-10cf9347cb8b</entry>
Nov 07 16:01:55 user nova-compute[75018]:       <entry name="uuid">75284cef-c065-4f26-80fb-10cf9347cb8b</entry>
Nov 07 16:01:55 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 16:01:55 user nova-compute[75018]:     </system>
Nov 07 16:01:55 user nova-compute[75018]:   </sysinfo>
Nov 07 16:01:55 user nova-compute[75018]:   <os>
Nov 07 16:01:55 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 16:01:55 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 16:01:55 user nova-compute[75018]:   </os>
Nov 07 16:01:55 user nova-compute[75018]:   <features>
Nov 07 16:01:55 user nova-compute[75018]:     <acpi/>
Nov 07 16:01:55 user nova-compute[75018]:     <apic/>
Nov 07 16:01:55 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 16:01:55 user nova-compute[75018]:   </features>
Nov 07 16:01:55 user nova-compute[75018]:   <clock offset="utc">
Nov 07 16:01:55 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 16:01:55 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 16:01:55 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 16:01:55 user nova-compute[75018]:   </clock>
Nov 07 16:01:55 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 16:01:55 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 16:01:55 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 16:01:55 user nova-compute[75018]:   </cpu>
Nov 07 16:01:55 user nova-compute[75018]:   <devices>
Nov 07 16:01:55 user nova-compute[75018]:     <disk type="block" device="disk">
Nov 07 16:01:55 user nova-compute[75018]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 16:01:55 user nova-compute[75018]:       <source dev="/dev/sdc"/>
Nov 07 16:01:55 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 16:01:55 user nova-compute[75018]:       <serial>1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e</serial>
Nov 07 16:01:55 user nova-compute[75018]:     </disk>
Nov 07 16:01:55 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 16:01:55 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 16:01:55 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/disk.rescue"/>
Nov 07 16:01:55 user nova-compute[75018]:       <target dev="vdb" bus="virtio"/>
Nov 07 16:01:55 user nova-compute[75018]:       <boot order="1"/>
Nov 07 16:01:55 user nova-compute[75018]:     </disk>
Nov 07 16:01:55 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 16:01:55 user nova-compute[75018]:       <mac address="fa:16:3e:45:e7:3b"/>
Nov 07 16:01:55 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 16:01:55 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 16:01:55 user nova-compute[75018]:       <target dev="tap70ac5c7e-5c"/>
Nov 07 16:01:55 user nova-compute[75018]:     </interface>
Nov 07 16:01:55 user nova-compute[75018]:     <serial type="pty">
Nov 07 16:01:55 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/console.log" append="off"/>
Nov 07 16:01:55 user nova-compute[75018]:     </serial>
Nov 07 16:01:55 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 16:01:55 user nova-compute[75018]:     <video>
Nov 07 16:01:55 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 16:01:55 user nova-compute[75018]:     </video>
Nov 07 16:01:55 user nova-compute[75018]:     <rng model="virtio">
Nov 07 16:01:55 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 16:01:55 user nova-compute[75018]:     </rng>
Nov 07 16:01:55 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 16:01:55 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 16:01:55 user nova-compute[75018]:       <stats period="10"/>
Nov 07 16:01:55 user nova-compute[75018]:     </memballoon>
Nov 07 16:01:55 user nova-compute[75018]:   </devices>
Nov 07 16:01:55 user nova-compute[75018]: </domain>
Nov 07 16:01:55 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 16:01:55 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Instance destroyed successfully.
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 16:01:55 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] No VIF found with MAC fa:16:3e:45:e7:3b, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 16:01:56 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Updating instance_info_cache with network_info: [{"id": "679c8723-2d01-42eb-b7f7-0a766b635f98", "address": "fa:16:3e:43:30:1d", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c8723-2d", "ovs_interfaceid": "679c8723-2d01-42eb-b7f7-0a766b635f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:01:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:01:56 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:01:56 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:01:56 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:01:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-331ec383-b8cb-490f-a96f-6f4e401befc1 req-0b664311-e33f-4960-9172-bbebd111b29d service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:01:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-331ec383-b8cb-490f-a96f-6f4e401befc1 req-0b664311-e33f-4960-9172-bbebd111b29d service nova] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:01:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-331ec383-b8cb-490f-a96f-6f4e401befc1 req-0b664311-e33f-4960-9172-bbebd111b29d service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:01:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-331ec383-b8cb-490f-a96f-6f4e401befc1 req-0b664311-e33f-4960-9172-bbebd111b29d service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:01:57 user nova-compute[75018]: DEBUG nova.compute.manager [req-331ec383-b8cb-490f-a96f-6f4e401befc1 req-0b664311-e33f-4960-9172-bbebd111b29d service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] No waiting events found dispatching network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:01:57 user nova-compute[75018]: WARNING nova.compute.manager [req-331ec383-b8cb-490f-a96f-6f4e401befc1 req-0b664311-e33f-4960-9172-bbebd111b29d service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received unexpected event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 for instance with vm_state active and task_state rescuing.
Nov 07 16:01:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:01:57 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:01:57 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75018) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 16:01:59 user nova-compute[75018]: DEBUG nova.compute.manager [None req-da0f6b83-383a-4053-9b08-6b8b60f40122 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 16:01:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-1c17214a-cb07-4e3f-9fa5-d15d37ce584a req-7ae2639e-2970-47d0-80c9-b2fb27c7757d service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:01:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1c17214a-cb07-4e3f-9fa5-d15d37ce584a req-7ae2639e-2970-47d0-80c9-b2fb27c7757d service nova] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:01:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1c17214a-cb07-4e3f-9fa5-d15d37ce584a req-7ae2639e-2970-47d0-80c9-b2fb27c7757d service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:01:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1c17214a-cb07-4e3f-9fa5-d15d37ce584a req-7ae2639e-2970-47d0-80c9-b2fb27c7757d service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:01:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-1c17214a-cb07-4e3f-9fa5-d15d37ce584a req-7ae2639e-2970-47d0-80c9-b2fb27c7757d service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] No waiting events found dispatching network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:01:59 user nova-compute[75018]: WARNING nova.compute.manager [req-1c17214a-cb07-4e3f-9fa5-d15d37ce584a req-7ae2639e-2970-47d0-80c9-b2fb27c7757d service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received unexpected event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 for instance with vm_state rescued and task_state None.
Nov 07 16:01:59 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:02:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:02:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:02:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:02:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:02:00 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:02:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:00 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:02:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:02:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:02:00 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:02:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:02:01 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:02:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:02:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:02:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:02:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:02:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:02:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:02:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:02:01 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:02:02 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:02:02 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=24.67355728149414GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 37a43352-eebc-4cea-84c7-0a337e7f9063 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 75284cef-c065-4f26-80fb-10cf9347cb8b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing inventories for resource provider 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating ProviderTree inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing aggregate associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, aggregates: None {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing trait associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:02:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:02:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:08 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:02:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:02:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:02:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:02:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:02:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:47 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:02:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:52 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:02:54 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:02:54 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:02:54 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:02:55 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:02:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:02:55 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:02:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:02:55 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:02:55 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:02:55 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid 8e787e6f-2844-4407-ba44-a60b5830cdab {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:02:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:02:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:02:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:02:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:02:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:02:56 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updating instance_info_cache with network_info: [{"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:02:56 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:02:56 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:02:57 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:02:57 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:03:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:03:01 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:03:02 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:03:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:03:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:03:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:03:02 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:03:02 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:03:02 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:03:02 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:03:02 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:03:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:03:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:03:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:03:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:03:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/disk.rescue --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:03:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:03:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:03:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:03:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:03:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:03:04 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:03:04 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:03:04 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8777MB free_disk=24.671703338623047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:03:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:03:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:03:04 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:03:04 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:03:04 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 37a43352-eebc-4cea-84c7-0a337e7f9063 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:03:04 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 75284cef-c065-4f26-80fb-10cf9347cb8b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:03:04 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:03:04 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:03:04 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:03:04 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:03:04 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:03:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:03:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:03:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:12 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:03:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:03:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:03:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:03:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:03:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:03:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:43 user nova-compute[75018]: INFO nova.compute.manager [None req-fad3db3d-4da7-45c2-b1b9-6f453c52c1f5 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Unrescuing
Nov 07 16:03:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fad3db3d-4da7-45c2-b1b9-6f453c52c1f5 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "refresh_cache-75284cef-c065-4f26-80fb-10cf9347cb8b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:03:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fad3db3d-4da7-45c2-b1b9-6f453c52c1f5 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquired lock "refresh_cache-75284cef-c065-4f26-80fb-10cf9347cb8b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:03:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fad3db3d-4da7-45c2-b1b9-6f453c52c1f5 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 16:03:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-fad3db3d-4da7-45c2-b1b9-6f453c52c1f5 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Updating instance_info_cache with network_info: [{"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:03:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-fad3db3d-4da7-45c2-b1b9-6f453c52c1f5 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Releasing lock "refresh_cache-75284cef-c065-4f26-80fb-10cf9347cb8b" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:03:43 user nova-compute[75018]: DEBUG nova.objects.instance [None req-fad3db3d-4da7-45c2-b1b9-6f453c52c1f5 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'flavor' on Instance uuid 75284cef-c065-4f26-80fb-10cf9347cb8b {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:03:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-c57fa064-202c-4404-8774-2f9f5f48e7e5 req-2142465f-e06f-4c36-b277-4cb458fae705 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-vif-unplugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:03:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c57fa064-202c-4404-8774-2f9f5f48e7e5 req-2142465f-e06f-4c36-b277-4cb458fae705 service nova] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:03:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c57fa064-202c-4404-8774-2f9f5f48e7e5 req-2142465f-e06f-4c36-b277-4cb458fae705 service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:03:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c57fa064-202c-4404-8774-2f9f5f48e7e5 req-2142465f-e06f-4c36-b277-4cb458fae705 service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:03:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-c57fa064-202c-4404-8774-2f9f5f48e7e5 req-2142465f-e06f-4c36-b277-4cb458fae705 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] No waiting events found dispatching network-vif-unplugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:03:43 user nova-compute[75018]: WARNING nova.compute.manager [req-c57fa064-202c-4404-8774-2f9f5f48e7e5 req-2142465f-e06f-4c36-b277-4cb458fae705 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received unexpected event network-vif-unplugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 for instance with vm_state rescued and task_state unrescuing.
Nov 07 16:03:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:44 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Instance destroyed successfully.
Nov 07 16:03:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-2d8cf379-c75b-4ba7-b6b5-dae7b1b9f550 req-da2316f4-b094-44a9-8b47-20b99ccb0eb1 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:03:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2d8cf379-c75b-4ba7-b6b5-dae7b1b9f550 req-da2316f4-b094-44a9-8b47-20b99ccb0eb1 service nova] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:03:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2d8cf379-c75b-4ba7-b6b5-dae7b1b9f550 req-da2316f4-b094-44a9-8b47-20b99ccb0eb1 service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:03:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2d8cf379-c75b-4ba7-b6b5-dae7b1b9f550 req-da2316f4-b094-44a9-8b47-20b99ccb0eb1 service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:03:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-2d8cf379-c75b-4ba7-b6b5-dae7b1b9f550 req-da2316f4-b094-44a9-8b47-20b99ccb0eb1 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] No waiting events found dispatching network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:03:45 user nova-compute[75018]: WARNING nova.compute.manager [req-2d8cf379-c75b-4ba7-b6b5-dae7b1b9f550 req-da2316f4-b094-44a9-8b47-20b99ccb0eb1 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received unexpected event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 for instance with vm_state rescued and task_state unrescuing.
Nov 07 16:03:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-2d8cf379-c75b-4ba7-b6b5-dae7b1b9f550 req-da2316f4-b094-44a9-8b47-20b99ccb0eb1 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:03:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2d8cf379-c75b-4ba7-b6b5-dae7b1b9f550 req-da2316f4-b094-44a9-8b47-20b99ccb0eb1 service nova] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:03:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2d8cf379-c75b-4ba7-b6b5-dae7b1b9f550 req-da2316f4-b094-44a9-8b47-20b99ccb0eb1 service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:03:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2d8cf379-c75b-4ba7-b6b5-dae7b1b9f550 req-da2316f4-b094-44a9-8b47-20b99ccb0eb1 service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:03:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-2d8cf379-c75b-4ba7-b6b5-dae7b1b9f550 req-da2316f4-b094-44a9-8b47-20b99ccb0eb1 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] No waiting events found dispatching network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:03:45 user nova-compute[75018]: WARNING nova.compute.manager [req-2d8cf379-c75b-4ba7-b6b5-dae7b1b9f550 req-da2316f4-b094-44a9-8b47-20b99ccb0eb1 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received unexpected event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 for instance with vm_state rescued and task_state unrescuing.
Nov 07 16:03:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-fad3db3d-4da7-45c2-b1b9-6f453c52c1f5 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 16:03:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-edec08de-3e55-460e-a08e-e00764c09676 req-ad5dc086-1e35-46b2-86ac-a0eaf76cf496 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:03:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-edec08de-3e55-460e-a08e-e00764c09676 req-ad5dc086-1e35-46b2-86ac-a0eaf76cf496 service nova] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:03:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-edec08de-3e55-460e-a08e-e00764c09676 req-ad5dc086-1e35-46b2-86ac-a0eaf76cf496 service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:03:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-edec08de-3e55-460e-a08e-e00764c09676 req-ad5dc086-1e35-46b2-86ac-a0eaf76cf496 service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:03:47 user nova-compute[75018]: DEBUG nova.compute.manager [req-edec08de-3e55-460e-a08e-e00764c09676 req-ad5dc086-1e35-46b2-86ac-a0eaf76cf496 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] No waiting events found dispatching network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:03:47 user nova-compute[75018]: WARNING nova.compute.manager [req-edec08de-3e55-460e-a08e-e00764c09676 req-ad5dc086-1e35-46b2-86ac-a0eaf76cf496 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received unexpected event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 for instance with vm_state active and task_state None.
Nov 07 16:03:49 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:03:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:03:53 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:03:55 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:03:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:03:56 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:03:56 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:03:57 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:03:57 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:03:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:03:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:03:57 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:03:58 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updating instance_info_cache with network_info: [{"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:03:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-fa037da8-53d1-4dcd-9478-59a9e9cfb726" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:03:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:03:58 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:03:58 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:04:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:01 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:04:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:03 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:04:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:04:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:04:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:04:03 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:04:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:04:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:04:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:04:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:04:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:04:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:04:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:04:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:04:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:04:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:04:04 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:04:04 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:04:04 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8689MB free_disk=24.671913146972656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:04:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:04:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:04:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:04:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:04:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 37a43352-eebc-4cea-84c7-0a337e7f9063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:04:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 75284cef-c065-4f26-80fb-10cf9347cb8b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:04:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:04:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:04:05 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:04:05 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:04:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:04:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:04:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:53 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:04:55 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:04:55 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:04:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:04:56 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:04:56 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:04:57 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:04:57 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:04:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:04:57 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:04:57 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:04:58 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Updating instance_info_cache with network_info: [{"id": "679c8723-2d01-42eb-b7f7-0a766b635f98", "address": "fa:16:3e:43:30:1d", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c8723-2d", "ovs_interfaceid": "679c8723-2d01-42eb-b7f7-0a766b635f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:04:58 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-37a43352-eebc-4cea-84c7-0a337e7f9063" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:04:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:04:58 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:04:59 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:05:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:01 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:05:03 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:05:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:05:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:05:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:05:03 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:05:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:05:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:05:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:05:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:05:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:05:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:05:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:05:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:05:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:05:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:05:04 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:05:04 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:05:04 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8802MB free_disk=24.671279907226562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:05:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:05:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:05:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:05:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:05:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 37a43352-eebc-4cea-84c7-0a337e7f9063 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:05:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 75284cef-c065-4f26-80fb-10cf9347cb8b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:05:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:05:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:05:05 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:05:05 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:05:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:05:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:05:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:05:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:12 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:05:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:05:34 user nova-compute[75018]: INFO nova.compute.manager [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Terminating instance
Nov 07 16:05:34 user nova-compute[75018]: DEBUG nova.compute.manager [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-a7cb34df-f0ef-438b-b4f6-79ee578e6836 req-c209f4c7-c3c6-4ad8-b76d-22dfde434ecb service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-vif-unplugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a7cb34df-f0ef-438b-b4f6-79ee578e6836 req-c209f4c7-c3c6-4ad8-b76d-22dfde434ecb service nova] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a7cb34df-f0ef-438b-b4f6-79ee578e6836 req-c209f4c7-c3c6-4ad8-b76d-22dfde434ecb service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a7cb34df-f0ef-438b-b4f6-79ee578e6836 req-c209f4c7-c3c6-4ad8-b76d-22dfde434ecb service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-a7cb34df-f0ef-438b-b4f6-79ee578e6836 req-c209f4c7-c3c6-4ad8-b76d-22dfde434ecb service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] No waiting events found dispatching network-vif-unplugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-a7cb34df-f0ef-438b-b4f6-79ee578e6836 req-c209f4c7-c3c6-4ad8-b76d-22dfde434ecb service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-vif-unplugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:34 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Instance destroyed successfully.
Nov 07 16:05:34 user nova-compute[75018]: DEBUG nova.objects.instance [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'resources' on Instance uuid 75284cef-c065-4f26-80fb-10cf9347cb8b {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:00:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-444402787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-444402787',id=47,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T16:01:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b703f914a00c4d5399fbd2a05d855e20',ramdisk_id='',reservation_id='r-581aiyf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T16:03:48Z,user_data=None,user_id='b85e59486dda47eeb7b0cf5ddf732ecf',uuid=75284cef-c065-4f26-80fb-10cf9347cb8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converting VIF {"id": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "address": "fa:16:3e:45:e7:3b", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ac5c7e-5c", "ovs_interfaceid": "70ac5c7e-5ca6-4c62-b2e9-195e41895453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:e7:3b,bridge_name='br-int',has_traffic_filtering=True,id=70ac5c7e-5ca6-4c62-b2e9-195e41895453,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ac5c7e-5c') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG os_vif [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:e7:3b,bridge_name='br-int',has_traffic_filtering=True,id=70ac5c7e-5ca6-4c62-b2e9-195e41895453,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ac5c7e-5c') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70ac5c7e-5c, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6c9e07e-0fb2-4ade-b7cc-f9d26bef4f6a) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:05:34 user nova-compute[75018]: INFO os_vif [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:e7:3b,bridge_name='br-int',has_traffic_filtering=True,id=70ac5c7e-5ca6-4c62-b2e9-195e41895453,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70ac5c7e-5c')
Nov 07 16:05:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcvUsjzR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 16:05:34 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:05:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07fb989-ae0a-4873-870c-63d259f14f85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 16:05:34 user nova-compute[75018]: No targets found.
Nov 07 16:05:34 user nova-compute[75018]: iSNS:
Nov 07 16:05:34 user nova-compute[75018]: No targets found.
Nov 07 16:05:34 user nova-compute[75018]: STATIC:
Nov 07 16:05:34 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9
Nov 07 16:05:34 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 16:05:34 user nova-compute[75018]:                 Iface Name: default
Nov 07 16:05:34 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e
Nov 07 16:05:34 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 16:05:34 user nova-compute[75018]:                 Iface Name: default
Nov 07 16:05:34 user nova-compute[75018]: FIRMWARE:
Nov 07 16:05:34 user nova-compute[75018]: No targets found.
Nov 07 16:05:34 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 16:05:34 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 16:05:34 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3184e27-fc37-44d5-b220-73fd52eebf88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d6a1d8-37d0-4080-85c7-d182de1a17c5]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 16:05:34 user nova-compute[75018]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e (non-flash)
Nov 07 16:05:34 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 16:05:34 user nova-compute[75018]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e (non-flash)
Nov 07 16:05:34 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae03ea830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e'): ({'sdc'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Removing single pathed devices sdc {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e097c187-10e0-4cbf-8734-0d4e2a847347]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2368a5-e65d-4a0e-b696-78e531a6c7b2]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Flushing IO for device /dev/sdc {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbd5723-d533-45c7-ab42-01f1f9443dae]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd7e5fa-89aa-46f5-b175-33e38749ad1c]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] SCSI volumes sdc have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e81099-6051-4d4c-90d9-407a8a23d93d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a04b6a-9847-4c02-8078-75ab6f6112b7]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e, portal: 172.16.0.220,3260]
Nov 07 16:05:35 user nova-compute[75018]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e, portal: 172.16.0.220,3260] successful.
Nov 07 16:05:35 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d94f3dd-3322-4d56-bdfc-6fed77ba1a4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[134b50a4-d312-4265-b5f9-7996076de97b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] <== disconnect_volume: return (309ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 16:05:35 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Deleting instance files /opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b_del
Nov 07 16:05:35 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Deletion of /opt/stack/data/nova/instances/75284cef-c065-4f26-80fb-10cf9347cb8b_del complete
Nov 07 16:05:35 user nova-compute[75018]: INFO nova.compute.manager [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 07 16:05:35 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:35 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:05:35 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Took 0.46 seconds to deallocate network for instance.
Nov 07 16:05:35 user nova-compute[75018]: DEBUG nova.compute.manager [req-e56c7e28-ce74-4236-bbd4-e1e5d83881f3 req-d7a846bb-4b4f-4a82-b8ab-d925f02e3071 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-vif-deleted-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:05:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-38151e9f-91da-473b-9d8e-b391f189d3ee req-23f3ddd5-eb48-4c0a-83f8-c3d0a94b9f53 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:05:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-38151e9f-91da-473b-9d8e-b391f189d3ee req-23f3ddd5-eb48-4c0a-83f8-c3d0a94b9f53 service nova] Acquiring lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:05:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-38151e9f-91da-473b-9d8e-b391f189d3ee req-23f3ddd5-eb48-4c0a-83f8-c3d0a94b9f53 service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:05:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-38151e9f-91da-473b-9d8e-b391f189d3ee req-23f3ddd5-eb48-4c0a-83f8-c3d0a94b9f53 service nova] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:05:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-38151e9f-91da-473b-9d8e-b391f189d3ee req-23f3ddd5-eb48-4c0a-83f8-c3d0a94b9f53 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] No waiting events found dispatching network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:05:36 user nova-compute[75018]: WARNING nova.compute.manager [req-38151e9f-91da-473b-9d8e-b391f189d3ee req-23f3ddd5-eb48-4c0a-83f8-c3d0a94b9f53 service nova] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Received unexpected event network-vif-plugged-70ac5c7e-5ca6-4c62-b2e9-195e41895453 for instance with vm_state active and task_state deleting.
Nov 07 16:05:36 user nova-compute[75018]: INFO nova.compute.manager [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 75284cef-c065-4f26-80fb-10cf9347cb8b] Took 0.96 seconds to detach 1 volumes for instance.
Nov 07 16:05:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:05:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:05:36 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:05:36 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:05:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:05:36 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Deleted allocations for instance 75284cef-c065-4f26-80fb-10cf9347cb8b
Nov 07 16:05:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-6d93a1d8-8907-41f6-b7fe-7443134ba56f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "75284cef-c065-4f26-80fb-10cf9347cb8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.985s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:05:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:05:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:05:51 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:05:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:05:56 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:05:57 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:05:58 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:05:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:05:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 16:05:58 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:05:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:05:59 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:05:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:06:03 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:06:03 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:06:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:06:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:06:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:06:03 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:06:03 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:06:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:06:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:06:03 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:06:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:06:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:06:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:06:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:06:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:06:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:04 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:06:04 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:06:04 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8858MB free_disk=24.670455932617188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:06:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:06:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:06:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:06:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:06:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 37a43352-eebc-4cea-84c7-0a337e7f9063 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:06:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:06:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:06:05 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:06:05 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:06:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:06:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:06:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:06:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:06:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:06:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:06:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:06:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "37a43352-eebc-4cea-84c7-0a337e7f9063" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:06:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:06:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:06:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:06:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:06:24 user nova-compute[75018]: INFO nova.compute.manager [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Terminating instance
Nov 07 16:06:24 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 16:06:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-c86ab745-8f8a-41ca-9567-82faa99a9d1c req-b1c3664f-f8ae-4e48-9738-166f4f90e88f service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Received event network-vif-unplugged-679c8723-2d01-42eb-b7f7-0a766b635f98 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c86ab745-8f8a-41ca-9567-82faa99a9d1c req-b1c3664f-f8ae-4e48-9738-166f4f90e88f service nova] Acquiring lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c86ab745-8f8a-41ca-9567-82faa99a9d1c req-b1c3664f-f8ae-4e48-9738-166f4f90e88f service nova] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-c86ab745-8f8a-41ca-9567-82faa99a9d1c req-b1c3664f-f8ae-4e48-9738-166f4f90e88f service nova] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-c86ab745-8f8a-41ca-9567-82faa99a9d1c req-b1c3664f-f8ae-4e48-9738-166f4f90e88f service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] No waiting events found dispatching network-vif-unplugged-679c8723-2d01-42eb-b7f7-0a766b635f98 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG nova.compute.manager [req-c86ab745-8f8a-41ca-9567-82faa99a9d1c req-b1c3664f-f8ae-4e48-9738-166f4f90e88f service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Received event network-vif-unplugged-679c8723-2d01-42eb-b7f7-0a766b635f98 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:25 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Instance destroyed successfully.
Nov 07 16:06:25 user nova-compute[75018]: DEBUG nova.objects.instance [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'resources' on Instance uuid 37a43352-eebc-4cea-84c7-0a337e7f9063 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1011584129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1011584129',id=46,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:56:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b703f914a00c4d5399fbd2a05d855e20',ramdisk_id='',reservation_id='r-ca83hunm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:58:10Z,user_data=None,user_id='b85e59486dda47eeb7b0cf5ddf732ecf',uuid=37a43352-eebc-4cea-84c7-0a337e7f9063,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "679c8723-2d01-42eb-b7f7-0a766b635f98", "address": "fa:16:3e:43:30:1d", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c8723-2d", "ovs_interfaceid": "679c8723-2d01-42eb-b7f7-0a766b635f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converting VIF {"id": "679c8723-2d01-42eb-b7f7-0a766b635f98", "address": "fa:16:3e:43:30:1d", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap679c8723-2d", "ovs_interfaceid": "679c8723-2d01-42eb-b7f7-0a766b635f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:30:1d,bridge_name='br-int',has_traffic_filtering=True,id=679c8723-2d01-42eb-b7f7-0a766b635f98,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679c8723-2d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG os_vif [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:30:1d,bridge_name='br-int',has_traffic_filtering=True,id=679c8723-2d01-42eb-b7f7-0a766b635f98,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679c8723-2d') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap679c8723-2d, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09b30b08-ce86-4cc6-bdac-5fc564c41e3d) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:06:25 user nova-compute[75018]: INFO os_vif [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:30:1d,bridge_name='br-int',has_traffic_filtering=True,id=679c8723-2d01-42eb-b7f7-0a766b635f98,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679c8723-2d')
Nov 07 16:06:25 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Deleting instance files /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063_del
Nov 07 16:06:25 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Deletion of /opt/stack/data/nova/instances/37a43352-eebc-4cea-84c7-0a337e7f9063_del complete
Nov 07 16:06:25 user nova-compute[75018]: INFO nova.compute.manager [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 07 16:06:25 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 16:06:25 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:06:25 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Took 0.51 seconds to deallocate network for instance.
Nov 07 16:06:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:06:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:06:26 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:06:26 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:06:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:06:26 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Deleted allocations for instance 37a43352-eebc-4cea-84c7-0a337e7f9063
Nov 07 16:06:26 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e835f188-85f7-4e5d-9c90-01f27f7edc5f tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.510s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:06:27 user nova-compute[75018]: DEBUG nova.compute.manager [req-34cb82b4-b7b8-42a5-a41b-39becbe69fa1 req-10d6e0cb-0116-4bf0-b7a9-31d9f4a9d99f service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Received event network-vif-plugged-679c8723-2d01-42eb-b7f7-0a766b635f98 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:06:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-34cb82b4-b7b8-42a5-a41b-39becbe69fa1 req-10d6e0cb-0116-4bf0-b7a9-31d9f4a9d99f service nova] Acquiring lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:06:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-34cb82b4-b7b8-42a5-a41b-39becbe69fa1 req-10d6e0cb-0116-4bf0-b7a9-31d9f4a9d99f service nova] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:06:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-34cb82b4-b7b8-42a5-a41b-39becbe69fa1 req-10d6e0cb-0116-4bf0-b7a9-31d9f4a9d99f service nova] Lock "37a43352-eebc-4cea-84c7-0a337e7f9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:06:27 user nova-compute[75018]: DEBUG nova.compute.manager [req-34cb82b4-b7b8-42a5-a41b-39becbe69fa1 req-10d6e0cb-0116-4bf0-b7a9-31d9f4a9d99f service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] No waiting events found dispatching network-vif-plugged-679c8723-2d01-42eb-b7f7-0a766b635f98 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:06:27 user nova-compute[75018]: WARNING nova.compute.manager [req-34cb82b4-b7b8-42a5-a41b-39becbe69fa1 req-10d6e0cb-0116-4bf0-b7a9-31d9f4a9d99f service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Received unexpected event network-vif-plugged-679c8723-2d01-42eb-b7f7-0a766b635f98 for instance with vm_state deleted and task_state None.
Nov 07 16:06:27 user nova-compute[75018]: DEBUG nova.compute.manager [req-34cb82b4-b7b8-42a5-a41b-39becbe69fa1 req-10d6e0cb-0116-4bf0-b7a9-31d9f4a9d99f service nova] [instance: 37a43352-eebc-4cea-84c7-0a337e7f9063] Received event network-vif-deleted-679c8723-2d01-42eb-b7f7-0a766b635f98 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:06:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:06:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:06:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:06:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:06:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:06:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:06:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:06:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:06:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:06:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:06:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:06:52 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:06:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 16:06:52 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] There are 0 instances to clean {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 16:06:53 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:06:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:06:57 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:06:58 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:06:58 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:06:58 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:06:59 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:06:59 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:06:59 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:06:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:06:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:06:59 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:06:59 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid 8e787e6f-2844-4407-ba44-a60b5830cdab {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:07:00 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updating instance_info_cache with network_info: [{"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:07:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-8e787e6f-2844-4407-ba44-a60b5830cdab" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:07:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:07:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:07:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75018) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 16:07:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:07:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:07:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:07:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:07:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:07:02 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:07:04 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:07:04 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:07:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:07:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:07:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:07:04 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:07:04 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:07:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:07:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:07:04 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:05 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:07:05 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:07:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=24.79507064819336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fa037da8-53d1-4dcd-9478-59a9e9cfb726 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing inventories for resource provider 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating ProviderTree inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing aggregate associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, aggregates: None {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing trait associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:07:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:07:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:07:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:07:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:07:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:07:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:07:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:07:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:07:15 user nova-compute[75018]: INFO nova.compute.manager [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Terminating instance
Nov 07 16:07:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 16:07:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:07:16 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Instance destroyed successfully.
Nov 07 16:07:16 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'resources' on Instance uuid fa037da8-53d1-4dcd-9478-59a9e9cfb726 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-501708816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-501708816',id=44,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:52:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b703f914a00c4d5399fbd2a05d855e20',ramdisk_id='',reservation_id='r-zva0adi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:54:26Z,user_data=None,user_id='b85e59486dda47eeb7b0cf5ddf732ecf',uuid=fa037da8-53d1-4dcd-9478-59a9e9cfb726,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converting VIF {"id": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "address": "fa:16:3e:25:62:87", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2c0b26-56", "ovs_interfaceid": "9a2c0b26-5663-4e79-8f4a-cd712d7cf718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:62:87,bridge_name='br-int',has_traffic_filtering=True,id=9a2c0b26-5663-4e79-8f4a-cd712d7cf718,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2c0b26-56') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_vif [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:62:87,bridge_name='br-int',has_traffic_filtering=True,id=9a2c0b26-5663-4e79-8f4a-cd712d7cf718,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2c0b26-56') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a2c0b26-56, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=428379d5-9e73-40a6-93c4-2797a717bf4b) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:07:16 user nova-compute[75018]: INFO os_vif [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:62:87,bridge_name='br-int',has_traffic_filtering=True,id=9a2c0b26-5663-4e79-8f4a-cd712d7cf718,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2c0b26-56')
Nov 07 16:07:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JanMNVyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 16:07:16 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-a12fe2be-fa6b-4530-973b-0778354a41a8 req-762e5df1-2d98-42fb-bd4c-6edd200fb7c2 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-vif-unplugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a12fe2be-fa6b-4530-973b-0778354a41a8 req-762e5df1-2d98-42fb-bd4c-6edd200fb7c2 service nova] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a12fe2be-fa6b-4530-973b-0778354a41a8 req-762e5df1-2d98-42fb-bd4c-6edd200fb7c2 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a12fe2be-fa6b-4530-973b-0778354a41a8 req-762e5df1-2d98-42fb-bd4c-6edd200fb7c2 service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-a12fe2be-fa6b-4530-973b-0778354a41a8 req-762e5df1-2d98-42fb-bd4c-6edd200fb7c2 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] No waiting events found dispatching network-vif-unplugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-a12fe2be-fa6b-4530-973b-0778354a41a8 req-762e5df1-2d98-42fb-bd4c-6edd200fb7c2 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-vif-unplugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43e6cfa-cd41-4b26-87be-4ab902797bc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 16:07:16 user nova-compute[75018]: No targets found.
Nov 07 16:07:16 user nova-compute[75018]: iSNS:
Nov 07 16:07:16 user nova-compute[75018]: No targets found.
Nov 07 16:07:16 user nova-compute[75018]: STATIC:
Nov 07 16:07:16 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9
Nov 07 16:07:16 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 16:07:16 user nova-compute[75018]:                 Iface Name: default
Nov 07 16:07:16 user nova-compute[75018]: FIRMWARE:
Nov 07 16:07:16 user nova-compute[75018]: No targets found.
Nov 07 16:07:16 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 16:07:16 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 16:07:16 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2c9b25-ee1a-4ea6-9b48-c3e577fa3f83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6915cf32-0014-4833-a5a1-16b189363a34]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 16:07:16 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 (non-flash)
Nov 07 16:07:16 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae02a7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6db16c2-7a1d-4024-8a2e-232c98e61db0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eadaf87-a663-4d29-9b69-aca20aec4bf8]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c39798-da47-44e6-bbd4-91cc81e511d1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1d215d-483b-4363-be54-790d3f95324e]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[297855a3-1b1e-4152-926d-093a71d1b027]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cfe840-c97b-4d51-8309-062765ae2320]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9, portal: 172.16.0.220,3260]
Nov 07 16:07:16 user nova-compute[75018]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9, portal: 172.16.0.220,3260] successful.
Nov 07 16:07:16 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14e2e95-1ea1-4a26-8020-9c2b54d69df9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[350049c1-0734-4850-a455-337d97a3df86]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] <== disconnect_volume: return (296ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 16:07:16 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Deleting instance files /opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726_del
Nov 07 16:07:16 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Deletion of /opt/stack/data/nova/instances/fa037da8-53d1-4dcd-9478-59a9e9cfb726_del complete
Nov 07 16:07:16 user nova-compute[75018]: INFO nova.compute.manager [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 07 16:07:16 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 16:07:16 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 16:07:17 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:07:17 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Took 0.58 seconds to deallocate network for instance.
Nov 07 16:07:17 user nova-compute[75018]: DEBUG nova.compute.manager [req-f948e6fb-f59d-430e-926f-3c34f9eb7a80 req-3d4455f6-3ce3-4a6f-b701-ad4da9e4c322 service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-vif-deleted-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:07:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:07:18 user nova-compute[75018]: INFO nova.compute.manager [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Took 1.00 seconds to detach 1 volumes for instance.
Nov 07 16:07:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:07:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:07:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-ffd829bd-da09-4f64-ac97-13fa4f3d5533 req-6cc562f3-fcab-4227-b276-77d3bd6f3f6a service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:07:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ffd829bd-da09-4f64-ac97-13fa4f3d5533 req-6cc562f3-fcab-4227-b276-77d3bd6f3f6a service nova] Acquiring lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:07:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ffd829bd-da09-4f64-ac97-13fa4f3d5533 req-6cc562f3-fcab-4227-b276-77d3bd6f3f6a service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:07:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-ffd829bd-da09-4f64-ac97-13fa4f3d5533 req-6cc562f3-fcab-4227-b276-77d3bd6f3f6a service nova] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:07:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-ffd829bd-da09-4f64-ac97-13fa4f3d5533 req-6cc562f3-fcab-4227-b276-77d3bd6f3f6a service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] No waiting events found dispatching network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:07:18 user nova-compute[75018]: WARNING nova.compute.manager [req-ffd829bd-da09-4f64-ac97-13fa4f3d5533 req-6cc562f3-fcab-4227-b276-77d3bd6f3f6a service nova] [instance: fa037da8-53d1-4dcd-9478-59a9e9cfb726] Received unexpected event network-vif-plugged-9a2c0b26-5663-4e79-8f4a-cd712d7cf718 for instance with vm_state deleted and task_state None.
Nov 07 16:07:18 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:07:18 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:07:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:07:18 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Deleted allocations for instance fa037da8-53d1-4dcd-9478-59a9e9cfb726
Nov 07 16:07:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c58e9309-695d-4b57-8217-80c5427ba50a tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "fa037da8-53d1-4dcd-9478-59a9e9cfb726" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.011s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:07:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:07:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:07:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:07:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:07:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:07:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:07:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:07:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:07:54 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:07:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:07:58 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:07:58 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:08:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:08:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:08:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 16:08:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:08:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:08:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:08:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:08:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:08:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:08:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:08:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:04 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:08:04 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:08:05 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:08:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:08:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:08:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:08:05 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:08:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:08:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:08:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:06 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:08:06 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:08:06 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8987MB free_disk=24.794307708740234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "8e787e6f-2844-4407-ba44-a60b5830cdab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:08:06 user nova-compute[75018]: INFO nova.compute.manager [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Terminating instance
Nov 07 16:08:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 8e787e6f-2844-4407-ba44-a60b5830cdab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG nova.compute.manager [req-cda4cc25-e9df-4e56-b6d1-0ceb903e03a1 req-d1f9ce7a-96e5-47c8-8b64-d3e5cb6442ef service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Received event network-vif-unplugged-3192852d-5bc2-4ea2-bf7c-95a5163f0d40 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cda4cc25-e9df-4e56-b6d1-0ceb903e03a1 req-d1f9ce7a-96e5-47c8-8b64-d3e5cb6442ef service nova] Acquiring lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cda4cc25-e9df-4e56-b6d1-0ceb903e03a1 req-d1f9ce7a-96e5-47c8-8b64-d3e5cb6442ef service nova] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-cda4cc25-e9df-4e56-b6d1-0ceb903e03a1 req-d1f9ce7a-96e5-47c8-8b64-d3e5cb6442ef service nova] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG nova.compute.manager [req-cda4cc25-e9df-4e56-b6d1-0ceb903e03a1 req-d1f9ce7a-96e5-47c8-8b64-d3e5cb6442ef service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] No waiting events found dispatching network-vif-unplugged-3192852d-5bc2-4ea2-bf7c-95a5163f0d40 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG nova.compute.manager [req-cda4cc25-e9df-4e56-b6d1-0ceb903e03a1 req-d1f9ce7a-96e5-47c8-8b64-d3e5cb6442ef service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Received event network-vif-unplugged-3192852d-5bc2-4ea2-bf7c-95a5163f0d40 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 16:08:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:07 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Instance destroyed successfully.
Nov 07 16:08:07 user nova-compute[75018]: DEBUG nova.objects.instance [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lazy-loading 'resources' on Instance uuid 8e787e6f-2844-4407-ba44-a60b5830cdab {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T15:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-367494956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-367494956',id=43,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T15:47:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b703f914a00c4d5399fbd2a05d855e20',ramdisk_id='',reservation_id='r-24hzlf7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T15:49:37Z,user_data=None,user_id='b85e59486dda47eeb7b0cf5ddf732ecf',uuid=8e787e6f-2844-4407-ba44-a60b5830cdab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converting VIF {"id": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "address": "fa:16:3e:df:ba:31", "network": {"id": "97879ff4-7fd3-4134-a2f3-d7305bd150a1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2039672910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b703f914a00c4d5399fbd2a05d855e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3192852d-5b", "ovs_interfaceid": "3192852d-5bc2-4ea2-bf7c-95a5163f0d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:ba:31,bridge_name='br-int',has_traffic_filtering=True,id=3192852d-5bc2-4ea2-bf7c-95a5163f0d40,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3192852d-5b') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG os_vif [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ba:31,bridge_name='br-int',has_traffic_filtering=True,id=3192852d-5bc2-4ea2-bf7c-95a5163f0d40,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3192852d-5b') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3192852d-5b, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afb9df6c-bcd7-4d14-8486-53ea065d3396) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:07 user nova-compute[75018]: INFO os_vif [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ba:31,bridge_name='br-int',has_traffic_filtering=True,id=3192852d-5bc2-4ea2-bf7c-95a5163f0d40,network=Network(97879ff4-7fd3-4134-a2f3-d7305bd150a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3192852d-5b')
Nov 07 16:08:07 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Deleting instance files /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab_del
Nov 07 16:08:07 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Deletion of /opt/stack/data/nova/instances/8e787e6f-2844-4407-ba44-a60b5830cdab_del complete
Nov 07 16:08:07 user nova-compute[75018]: INFO nova.compute.manager [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 07 16:08:07 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:08:07 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Took 0.54 seconds to deallocate network for instance.
Nov 07 16:08:07 user nova-compute[75018]: DEBUG nova.compute.manager [req-8df3b671-a706-47c3-93ac-0e87b5463321 req-e108a5c8-f2bb-4d41-bb0f-850cf4d23844 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Received event network-vif-deleted-3192852d-5bc2-4ea2-bf7c-95a5163f0d40 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:08:07 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:08:08 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:08:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:08:08 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Deleted allocations for instance 8e787e6f-2844-4407-ba44-a60b5830cdab
Nov 07 16:08:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-1fdf9578-b2ab-48fd-beea-35952a4d27a3 tempest-ServerBootFromVolumeStableRescueTest-1314994176 tempest-ServerBootFromVolumeStableRescueTest-1314994176-project-member] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.670s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:08:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-d6d8a92a-d4ee-431d-aacb-d9ccc0980bc7 req-85f380ca-2b7a-4246-b18c-cabc1a9686e9 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Received event network-vif-plugged-3192852d-5bc2-4ea2-bf7c-95a5163f0d40 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:08:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d6d8a92a-d4ee-431d-aacb-d9ccc0980bc7 req-85f380ca-2b7a-4246-b18c-cabc1a9686e9 service nova] Acquiring lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:08:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d6d8a92a-d4ee-431d-aacb-d9ccc0980bc7 req-85f380ca-2b7a-4246-b18c-cabc1a9686e9 service nova] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:08:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-d6d8a92a-d4ee-431d-aacb-d9ccc0980bc7 req-85f380ca-2b7a-4246-b18c-cabc1a9686e9 service nova] Lock "8e787e6f-2844-4407-ba44-a60b5830cdab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:08:08 user nova-compute[75018]: DEBUG nova.compute.manager [req-d6d8a92a-d4ee-431d-aacb-d9ccc0980bc7 req-85f380ca-2b7a-4246-b18c-cabc1a9686e9 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] No waiting events found dispatching network-vif-plugged-3192852d-5bc2-4ea2-bf7c-95a5163f0d40 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:08:08 user nova-compute[75018]: WARNING nova.compute.manager [req-d6d8a92a-d4ee-431d-aacb-d9ccc0980bc7 req-85f380ca-2b7a-4246-b18c-cabc1a9686e9 service nova] [instance: 8e787e6f-2844-4407-ba44-a60b5830cdab] Received unexpected event network-vif-plugged-3192852d-5bc2-4ea2-bf7c-95a5163f0d40 for instance with vm_state deleted and task_state None.
Nov 07 16:08:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:17 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:08:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:08:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:08:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:08:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:08:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:25 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:08:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:32 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:08:37 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:08:42 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:47 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:08:52 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:54 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:08:57 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:08:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:08:59 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:09:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:09:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:09:01 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:09:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:09:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:09:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 16:09:01 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:09:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:09:02 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:05 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:09:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:06 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:09:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:07 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:09:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:09:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:09:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:09:07 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:09:08 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:09:08 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:09:08 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=9110MB free_disk=24.918224334716797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:09:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:09:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:09:08 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:09:08 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:09:08 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:09:08 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:09:08 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:09:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:09:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "a24b7d67-64e5-4051-addb-28afde08f08d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:09:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "a24b7d67-64e5-4051-addb-28afde08f08d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:09:08 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 16:09:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:09:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:09:08 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 16:09:08 user nova-compute[75018]: INFO nova.compute.claims [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Claim successful on node user
Nov 07 16:09:09 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 16:09:09 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 16:09:09 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG nova.policy [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98eb4211b01e424a9f185ab1db143e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757bf62aa5914b798354f519fcb931ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 16:09:09 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Creating image(s)
Nov 07 16:09:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "/opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "/opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "/opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.168s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.185s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Successfully created port: fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk 1073741824" returned: 0 in 0.048s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:09:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Cannot resize image /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Ensure instance console log exists: /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Successfully updated port: fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquired lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-8873010c-eaba-4151-a56d-200151ecfe2f req-9a727d67-1322-4feb-99b0-49bc617b3790 service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Received event network-changed-fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.compute.manager [req-8873010c-eaba-4151-a56d-200151ecfe2f req-9a727d67-1322-4feb-99b0-49bc617b3790 service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Refreshing instance network info cache due to event network-changed-fba0da97-6901-452b-809f-e1294b964686. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8873010c-eaba-4151-a56d-200151ecfe2f req-9a727d67-1322-4feb-99b0-49bc617b3790 service nova] Acquiring lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.network.neutron [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updating instance_info_cache with network_info: [{"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Releasing lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Instance network_info: |[{"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8873010c-eaba-4151-a56d-200151ecfe2f req-9a727d67-1322-4feb-99b0-49bc617b3790 service nova] Acquired lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.network.neutron [req-8873010c-eaba-4151-a56d-200151ecfe2f req-9a727d67-1322-4feb-99b0-49bc617b3790 service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Refreshing network info cache for port fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Start _get_guest_xml network_info=[{"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 16:09:10 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:09:10 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1391827290',display_name='tempest-AttachVolumeNegativeTest-server-1391827290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1391827290',id=48,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPV253lz00bwVAUkgtbMJ916CnWZ6AiAjm3MlMWqqd1wzhGZQBjLlbx2LW7ktyx3QIkwauXdPRaaDMv9OfO3NI5z5eKoP9MonqLot7DCmvtOjgNsLDQytrjWqFyNtPYdGA==',key_name='tempest-keypair-1395594798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757bf62aa5914b798354f519fcb931ab',ramdisk_id='',reservation_id='r-vc05x3uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1198936328',owner_user_name='tempest-AttachVolumeNegativeTest-1198936328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T16:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98eb4211b01e424a9f185ab1db143e7a',uuid=a24b7d67-64e5-4051-addb-28afde08f08d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converting VIF {"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:10:e3,bridge_name='br-int',has_traffic_filtering=True,id=fba0da97-6901-452b-809f-e1294b964686,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba0da97-69') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.objects.instance [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'pci_devices' on Instance uuid a24b7d67-64e5-4051-addb-28afde08f08d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] End _get_guest_xml xml=<domain type="kvm">
Nov 07 16:09:10 user nova-compute[75018]:   <uuid>a24b7d67-64e5-4051-addb-28afde08f08d</uuid>
Nov 07 16:09:10 user nova-compute[75018]:   <name>instance-00000030</name>
Nov 07 16:09:10 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 16:09:10 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 16:09:10 user nova-compute[75018]:   <metadata>
Nov 07 16:09:10 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 16:09:10 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 16:09:10 user nova-compute[75018]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1391827290</nova:name>
Nov 07 16:09:10 user nova-compute[75018]:       <nova:creationTime>2023-11-07 16:09:10</nova:creationTime>
Nov 07 16:09:10 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 16:09:10 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 16:09:10 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 16:09:10 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 16:09:10 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 16:09:10 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 16:09:10 user nova-compute[75018]:       </nova:flavor>
Nov 07 16:09:10 user nova-compute[75018]:       <nova:owner>
Nov 07 16:09:10 user nova-compute[75018]:         <nova:user uuid="98eb4211b01e424a9f185ab1db143e7a">tempest-AttachVolumeNegativeTest-1198936328-project-member</nova:user>
Nov 07 16:09:10 user nova-compute[75018]:         <nova:project uuid="757bf62aa5914b798354f519fcb931ab">tempest-AttachVolumeNegativeTest-1198936328</nova:project>
Nov 07 16:09:10 user nova-compute[75018]:       </nova:owner>
Nov 07 16:09:10 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 16:09:10 user nova-compute[75018]:       <nova:ports>
Nov 07 16:09:10 user nova-compute[75018]:         <nova:port uuid="fba0da97-6901-452b-809f-e1294b964686">
Nov 07 16:09:10 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 16:09:10 user nova-compute[75018]:         </nova:port>
Nov 07 16:09:10 user nova-compute[75018]:       </nova:ports>
Nov 07 16:09:10 user nova-compute[75018]:     </nova:instance>
Nov 07 16:09:10 user nova-compute[75018]:   </metadata>
Nov 07 16:09:10 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 16:09:10 user nova-compute[75018]:     <system>
Nov 07 16:09:10 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 16:09:10 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 16:09:10 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 16:09:10 user nova-compute[75018]:       <entry name="serial">a24b7d67-64e5-4051-addb-28afde08f08d</entry>
Nov 07 16:09:10 user nova-compute[75018]:       <entry name="uuid">a24b7d67-64e5-4051-addb-28afde08f08d</entry>
Nov 07 16:09:10 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 16:09:10 user nova-compute[75018]:     </system>
Nov 07 16:09:10 user nova-compute[75018]:   </sysinfo>
Nov 07 16:09:10 user nova-compute[75018]:   <os>
Nov 07 16:09:10 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 16:09:10 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 16:09:10 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 16:09:10 user nova-compute[75018]:   </os>
Nov 07 16:09:10 user nova-compute[75018]:   <features>
Nov 07 16:09:10 user nova-compute[75018]:     <acpi/>
Nov 07 16:09:10 user nova-compute[75018]:     <apic/>
Nov 07 16:09:10 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 16:09:10 user nova-compute[75018]:   </features>
Nov 07 16:09:10 user nova-compute[75018]:   <clock offset="utc">
Nov 07 16:09:10 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 16:09:10 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 16:09:10 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 16:09:10 user nova-compute[75018]:   </clock>
Nov 07 16:09:10 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 16:09:10 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 16:09:10 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 16:09:10 user nova-compute[75018]:   </cpu>
Nov 07 16:09:10 user nova-compute[75018]:   <devices>
Nov 07 16:09:10 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 16:09:10 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 16:09:10 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk"/>
Nov 07 16:09:10 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 16:09:10 user nova-compute[75018]:     </disk>
Nov 07 16:09:10 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 16:09:10 user nova-compute[75018]:       <mac address="fa:16:3e:66:10:e3"/>
Nov 07 16:09:10 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 16:09:10 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 16:09:10 user nova-compute[75018]:       <target dev="tapfba0da97-69"/>
Nov 07 16:09:10 user nova-compute[75018]:     </interface>
Nov 07 16:09:10 user nova-compute[75018]:     <serial type="pty">
Nov 07 16:09:10 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/console.log" append="off"/>
Nov 07 16:09:10 user nova-compute[75018]:     </serial>
Nov 07 16:09:10 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 16:09:10 user nova-compute[75018]:     <video>
Nov 07 16:09:10 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 16:09:10 user nova-compute[75018]:     </video>
Nov 07 16:09:10 user nova-compute[75018]:     <rng model="virtio">
Nov 07 16:09:10 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 16:09:10 user nova-compute[75018]:     </rng>
Nov 07 16:09:10 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 16:09:10 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 16:09:10 user nova-compute[75018]:       <stats period="10"/>
Nov 07 16:09:10 user nova-compute[75018]:     </memballoon>
Nov 07 16:09:10 user nova-compute[75018]:   </devices>
Nov 07 16:09:10 user nova-compute[75018]: </domain>
Nov 07 16:09:10 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1391827290',display_name='tempest-AttachVolumeNegativeTest-server-1391827290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1391827290',id=48,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPV253lz00bwVAUkgtbMJ916CnWZ6AiAjm3MlMWqqd1wzhGZQBjLlbx2LW7ktyx3QIkwauXdPRaaDMv9OfO3NI5z5eKoP9MonqLot7DCmvtOjgNsLDQytrjWqFyNtPYdGA==',key_name='tempest-keypair-1395594798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757bf62aa5914b798354f519fcb931ab',ramdisk_id='',reservation_id='r-vc05x3uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1198936328',owner_user_name='tempest-AttachVolumeNegativeTest-1198936328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T16:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98eb4211b01e424a9f185ab1db143e7a',uuid=a24b7d67-64e5-4051-addb-28afde08f08d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converting VIF {"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:10:e3,bridge_name='br-int',has_traffic_filtering=True,id=fba0da97-6901-452b-809f-e1294b964686,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba0da97-69') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG os_vif [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:10:e3,bridge_name='br-int',has_traffic_filtering=True,id=fba0da97-6901-452b-809f-e1294b964686,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba0da97-69') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a25ee52a-9eeb-51bf-8e1d-dcc5ffb05c69', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfba0da97-69, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfba0da97-69, col_values=(('qos', UUID('136948c4-3ecc-4311-ba30-78d1b2d2184a')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfba0da97-69, col_values=(('external_ids', {'iface-id': 'fba0da97-6901-452b-809f-e1294b964686', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:10:e3', 'vm-uuid': 'a24b7d67-64e5-4051-addb-28afde08f08d'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:10 user nova-compute[75018]: INFO os_vif [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:10:e3,bridge_name='br-int',has_traffic_filtering=True,id=fba0da97-6901-452b-809f-e1294b964686,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba0da97-69')
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 16:09:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No VIF found with MAC fa:16:3e:66:10:e3, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 16:09:11 user nova-compute[75018]: DEBUG nova.network.neutron [req-8873010c-eaba-4151-a56d-200151ecfe2f req-9a727d67-1322-4feb-99b0-49bc617b3790 service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updated VIF entry in instance network info cache for port fba0da97-6901-452b-809f-e1294b964686. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 16:09:11 user nova-compute[75018]: DEBUG nova.network.neutron [req-8873010c-eaba-4151-a56d-200151ecfe2f req-9a727d67-1322-4feb-99b0-49bc617b3790 service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updating instance_info_cache with network_info: [{"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:09:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-8873010c-eaba-4151-a56d-200151ecfe2f req-9a727d67-1322-4feb-99b0-49bc617b3790 service nova] Releasing lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:09:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:12 user nova-compute[75018]: DEBUG nova.compute.manager [req-57bf2f98-00b9-4d1b-a66d-c35f1a8fe503 req-91908628-a3ed-4dee-8917-566e4aceeb71 service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Received event network-vif-plugged-fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:09:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-57bf2f98-00b9-4d1b-a66d-c35f1a8fe503 req-91908628-a3ed-4dee-8917-566e4aceeb71 service nova] Acquiring lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:09:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-57bf2f98-00b9-4d1b-a66d-c35f1a8fe503 req-91908628-a3ed-4dee-8917-566e4aceeb71 service nova] Lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:09:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-57bf2f98-00b9-4d1b-a66d-c35f1a8fe503 req-91908628-a3ed-4dee-8917-566e4aceeb71 service nova] Lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:09:12 user nova-compute[75018]: DEBUG nova.compute.manager [req-57bf2f98-00b9-4d1b-a66d-c35f1a8fe503 req-91908628-a3ed-4dee-8917-566e4aceeb71 service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] No waiting events found dispatching network-vif-plugged-fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:09:12 user nova-compute[75018]: WARNING nova.compute.manager [req-57bf2f98-00b9-4d1b-a66d-c35f1a8fe503 req-91908628-a3ed-4dee-8917-566e4aceeb71 service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Received unexpected event network-vif-plugged-fba0da97-6901-452b-809f-e1294b964686 for instance with vm_state building and task_state spawning.
Nov 07 16:09:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 16:09:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 16:09:14 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Instance spawned successfully.
Nov 07 16:09:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 16:09:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:09:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:09:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:09:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:09:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:09:14 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:09:14 user nova-compute[75018]: INFO nova.compute.manager [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 07 16:09:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 16:09:14 user nova-compute[75018]: DEBUG nova.compute.manager [req-222ee190-2b6b-4b5c-8769-1745e9d43e35 req-c6ab5a19-fb56-4294-a8e5-23d9c08ce3e7 service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Received event network-vif-plugged-fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:09:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-222ee190-2b6b-4b5c-8769-1745e9d43e35 req-c6ab5a19-fb56-4294-a8e5-23d9c08ce3e7 service nova] Acquiring lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:09:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-222ee190-2b6b-4b5c-8769-1745e9d43e35 req-c6ab5a19-fb56-4294-a8e5-23d9c08ce3e7 service nova] Lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:09:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-222ee190-2b6b-4b5c-8769-1745e9d43e35 req-c6ab5a19-fb56-4294-a8e5-23d9c08ce3e7 service nova] Lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:09:14 user nova-compute[75018]: DEBUG nova.compute.manager [req-222ee190-2b6b-4b5c-8769-1745e9d43e35 req-c6ab5a19-fb56-4294-a8e5-23d9c08ce3e7 service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] No waiting events found dispatching network-vif-plugged-fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:09:14 user nova-compute[75018]: WARNING nova.compute.manager [req-222ee190-2b6b-4b5c-8769-1745e9d43e35 req-c6ab5a19-fb56-4294-a8e5-23d9c08ce3e7 service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Received unexpected event network-vif-plugged-fba0da97-6901-452b-809f-e1294b964686 for instance with vm_state building and task_state spawning.
Nov 07 16:09:14 user nova-compute[75018]: INFO nova.compute.manager [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Took 5.55 seconds to build instance.
Nov 07 16:09:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-c461b588-80a2-4abe-8f42-36058de5be8c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "a24b7d67-64e5-4051-addb-28afde08f08d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.633s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:09:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:18 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:09:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:55 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:09:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:09:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:09:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:09:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:09:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:09:59 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:10:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:10:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:10:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:10:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:10:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:10:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:10:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:10:01 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:10:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:10:01 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:10:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:10:01 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:10:01 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:10:01 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid a24b7d67-64e5-4051-addb-28afde08f08d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:10:02 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updating instance_info_cache with network_info: [{"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:10:02 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:10:02 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:10:03 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:10:03 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:10:03 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:10:05 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:10:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:10:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:10:08 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:10:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:10:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:10:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:10:08 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:10:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:10:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:10:08 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:10:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:10:09 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:10:09 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:10:09 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=24.880840301513672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:10:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:10:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:10:09 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance a24b7d67-64e5-4051-addb-28afde08f08d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:10:09 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:10:09 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:10:09 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:10:09 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:10:09 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:10:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:10:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:10:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:10:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:10:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:10:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:10:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:10:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:10:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:10:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:10:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:10:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:10:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:10:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:10:50 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:10:55 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:10:57 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:10:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-e9f912b1-8afd-442a-9c1c-b28d5587a3ba req-672c2177-945a-446d-a770-83920e88ff6b service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Received event network-changed-fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:10:59 user nova-compute[75018]: DEBUG nova.compute.manager [req-e9f912b1-8afd-442a-9c1c-b28d5587a3ba req-672c2177-945a-446d-a770-83920e88ff6b service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Refreshing instance network info cache due to event network-changed-fba0da97-6901-452b-809f-e1294b964686. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 16:10:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e9f912b1-8afd-442a-9c1c-b28d5587a3ba req-672c2177-945a-446d-a770-83920e88ff6b service nova] Acquiring lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:10:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e9f912b1-8afd-442a-9c1c-b28d5587a3ba req-672c2177-945a-446d-a770-83920e88ff6b service nova] Acquired lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:10:59 user nova-compute[75018]: DEBUG nova.network.neutron [req-e9f912b1-8afd-442a-9c1c-b28d5587a3ba req-672c2177-945a-446d-a770-83920e88ff6b service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Refreshing network info cache for port fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 16:11:00 user nova-compute[75018]: DEBUG nova.network.neutron [req-e9f912b1-8afd-442a-9c1c-b28d5587a3ba req-672c2177-945a-446d-a770-83920e88ff6b service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updated VIF entry in instance network info cache for port fba0da97-6901-452b-809f-e1294b964686. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 16:11:00 user nova-compute[75018]: DEBUG nova.network.neutron [req-e9f912b1-8afd-442a-9c1c-b28d5587a3ba req-672c2177-945a-446d-a770-83920e88ff6b service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updating instance_info_cache with network_info: [{"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:11:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e9f912b1-8afd-442a-9c1c-b28d5587a3ba req-672c2177-945a-446d-a770-83920e88ff6b service nova] Releasing lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:11:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:11:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:11:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:11:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:11:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:11:00 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:01 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:11:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:02 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:11:03 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:11:03 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:11:03 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:11:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:11:03 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:11:03 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:11:03 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid a24b7d67-64e5-4051-addb-28afde08f08d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:11:04 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updating instance_info_cache with network_info: [{"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:11:04 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:11:04 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:11:04 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:11:04 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:11:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "a24b7d67-64e5-4051-addb-28afde08f08d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:11:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "a24b7d67-64e5-4051-addb-28afde08f08d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:11:05 user nova-compute[75018]: DEBUG nova.objects.instance [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'flavor' on Instance uuid a24b7d67-64e5-4051-addb-28afde08f08d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:11:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "a24b7d67-64e5-4051-addb-28afde08f08d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:11:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "a24b7d67-64e5-4051-addb-28afde08f08d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:11:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "a24b7d67-64e5-4051-addb-28afde08f08d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:11:05 user nova-compute[75018]: INFO nova.compute.manager [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Attaching volume 3b4dad34-d055-4c86-8785-006532ee9cec to /dev/vdb
Nov 07 16:11:05 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:05 user nova-compute[75018]: DEBUG os_brick.utils [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 16:11:05 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c669b9e-d299-4feb-9208-25370d30c12c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba46851-36b7-4b78-810f-8ffbf7974249]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f1bc45-0784-45e3-8e0c-60df32510b5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e52dc1-080a-4f5d-8a5c-83c49a237402]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 16:11:06 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 16:11:06 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e7e3af-e726-4a85-aed5-d3588cf0e823]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG os_brick.utils [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updating existing volume attachment record: 6d8bd827-737b-49be-b53c-cdd5da4af8d5 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 16:11:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:11:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:11:09 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:11:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:11:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:11:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:11:09 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:11:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:09 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:10 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:11:10 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:11:10 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=24.880062103271484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:11:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:11:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:11:10 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance a24b7d67-64e5-4051-addb-28afde08f08d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:11:10 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:11:10 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:11:10 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:11:10 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:11:10 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:11:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:11:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:18 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:11:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:25 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:30 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:35 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgtOnYCo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 16:11:36 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:11:36 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:11:36 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dfaa86-7c56-48fb-b548-43a265a8af06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 16:11:36 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bec527-479a-4d80-8f4a-7bbc9f06c02c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec] added
Nov 07 16:11:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae9f24c-16bc-4fbf-ac07-2d9e160733d8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e559a7a8-6f60-46fc-b6c0-beb84d3e7ed1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgtOnYCo {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgtOnYCo" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3aa09ad-3c67-456c-9374-2049ecde4286]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IgtOnYCo'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ceea68-1dad-4651-8b8d-42b5aeed5593]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a0a885-2b0f-47ec-a86c-16575efb52ac]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 16:11:36 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 16:11:36 user nova-compute[75018]:  {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 16:11:36 user nova-compute[75018]: WARNING os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 16:11:36 user nova-compute[75018]: 
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfdaa0f-f24b-42fe-91d1-72bdf3ab8e74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec, portal: 172.16.0.220,3260]
Nov 07 16:11:36 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec, portal: 172.16.0.220,3260] successful.
Nov 07 16:11:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[06570d0a-a4f7-4ee3-97cd-846e2e54afc1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f83a8d-e050-4363-97fb-0114af9d0afa]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec (non-flash)
Nov 07 16:11:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec (non-flash)
Nov 07 16:11:36 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a246fb-dc6e-494e-abb1-03453fc66485]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 16:11:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgtOnYCo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 16:11:37 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:11:37 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23639396233396533', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 16:11:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639396233396533', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 16:11:37 user nova-compute[75018]: DEBUG nova.objects.instance [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'flavor' on Instance uuid a24b7d67-64e5-4051-addb-28afde08f08d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:11:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 16:11:37 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 16:11:37 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 16:11:37 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 16:11:37 user nova-compute[75018]:   <serial>3b4dad34-d055-4c86-8785-006532ee9cec</serial>
Nov 07 16:11:37 user nova-compute[75018]: </disk>
Nov 07 16:11:37 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 16:11:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 16:11:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 16:11:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No VIF found with MAC fa:16:3e:66:10:e3, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 16:11:38 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-43a7be3c-534d-4649-b769-f82a1ee7c6a9 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "a24b7d67-64e5-4051-addb-28afde08f08d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.751s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:11:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:40 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "088a647a-9091-4991-a763-11561d00db02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:11:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "088a647a-9091-4991-a763-11561d00db02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:11:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 16:11:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:11:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:11:41 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 16:11:41 user nova-compute[75018]: INFO nova.compute.claims [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Claim successful on node user
Nov 07 16:11:41 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:11:41 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:11:41 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:11:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 16:11:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 16:11:41 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 16:11:41 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 16:11:41 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG nova.policy [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98eb4211b01e424a9f185ab1db143e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757bf62aa5914b798354f519fcb931ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 16:11:42 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Creating image(s)
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "/opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "/opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "/opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.168s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.168s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk 1073741824" returned: 0 in 0.053s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.171s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Successfully created port: 2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Cannot resize image /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Ensure instance console log exists: /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:11:42 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Successfully updated port: 2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "refresh_cache-088a647a-9091-4991-a763-11561d00db02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquired lock "refresh_cache-088a647a-9091-4991-a763-11561d00db02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-6a3b2533-43ee-4e07-9136-327333b69090 req-5bb0aafc-308c-4395-961b-2c483ad5af83 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Received event network-changed-2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.compute.manager [req-6a3b2533-43ee-4e07-9136-327333b69090 req-5bb0aafc-308c-4395-961b-2c483ad5af83 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Refreshing instance network info cache due to event network-changed-2dada251-90c4-43bd-a811-ca9e2d43f9b7. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6a3b2533-43ee-4e07-9136-327333b69090 req-5bb0aafc-308c-4395-961b-2c483ad5af83 service nova] Acquiring lock "refresh_cache-088a647a-9091-4991-a763-11561d00db02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.network.neutron [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Updating instance_info_cache with network_info: [{"id": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "address": "fa:16:3e:b7:b2:86", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dada251-90", "ovs_interfaceid": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Releasing lock "refresh_cache-088a647a-9091-4991-a763-11561d00db02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Instance network_info: |[{"id": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "address": "fa:16:3e:b7:b2:86", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dada251-90", "ovs_interfaceid": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6a3b2533-43ee-4e07-9136-327333b69090 req-5bb0aafc-308c-4395-961b-2c483ad5af83 service nova] Acquired lock "refresh_cache-088a647a-9091-4991-a763-11561d00db02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.network.neutron [req-6a3b2533-43ee-4e07-9136-327333b69090 req-5bb0aafc-308c-4395-961b-2c483ad5af83 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Refreshing network info cache for port 2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Start _get_guest_xml network_info=[{"id": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "address": "fa:16:3e:b7:b2:86", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dada251-90", "ovs_interfaceid": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 16:11:43 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:11:43 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-39183955',display_name='tempest-AttachVolumeNegativeTest-server-39183955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-39183955',id=49,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdbZZQeaP0VITKclWjFjqQYfSdOx0hx2iefU5GBUiR0egePGXtxo9aYj6r2Hmp/O/9gGwFMoXyTgDlHJg3dOvl65V3d6eXztlrNdYIQ0mHZnKh4rza2dAegx/vGkyiFwg==',key_name='tempest-keypair-916367005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757bf62aa5914b798354f519fcb931ab',ramdisk_id='',reservation_id='r-9cm7z490',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1198936328',owner_user_name='tempest-AttachVolumeNegativeTest-1198936328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T16:11:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98eb4211b01e424a9f185ab1db143e7a',uuid=088a647a-9091-4991-a763-11561d00db02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "address": "fa:16:3e:b7:b2:86", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dada251-90", "ovs_interfaceid": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converting VIF {"id": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "address": "fa:16:3e:b7:b2:86", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dada251-90", "ovs_interfaceid": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b2:86,bridge_name='br-int',has_traffic_filtering=True,id=2dada251-90c4-43bd-a811-ca9e2d43f9b7,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dada251-90') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.objects.instance [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'pci_devices' on Instance uuid 088a647a-9091-4991-a763-11561d00db02 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] End _get_guest_xml xml=<domain type="kvm">
Nov 07 16:11:43 user nova-compute[75018]:   <uuid>088a647a-9091-4991-a763-11561d00db02</uuid>
Nov 07 16:11:43 user nova-compute[75018]:   <name>instance-00000031</name>
Nov 07 16:11:43 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 16:11:43 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 16:11:43 user nova-compute[75018]:   <metadata>
Nov 07 16:11:43 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 16:11:43 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 16:11:43 user nova-compute[75018]:       <nova:name>tempest-AttachVolumeNegativeTest-server-39183955</nova:name>
Nov 07 16:11:43 user nova-compute[75018]:       <nova:creationTime>2023-11-07 16:11:43</nova:creationTime>
Nov 07 16:11:43 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 16:11:43 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 16:11:43 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 16:11:43 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 16:11:43 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 16:11:43 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 16:11:43 user nova-compute[75018]:       </nova:flavor>
Nov 07 16:11:43 user nova-compute[75018]:       <nova:owner>
Nov 07 16:11:43 user nova-compute[75018]:         <nova:user uuid="98eb4211b01e424a9f185ab1db143e7a">tempest-AttachVolumeNegativeTest-1198936328-project-member</nova:user>
Nov 07 16:11:43 user nova-compute[75018]:         <nova:project uuid="757bf62aa5914b798354f519fcb931ab">tempest-AttachVolumeNegativeTest-1198936328</nova:project>
Nov 07 16:11:43 user nova-compute[75018]:       </nova:owner>
Nov 07 16:11:43 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 16:11:43 user nova-compute[75018]:       <nova:ports>
Nov 07 16:11:43 user nova-compute[75018]:         <nova:port uuid="2dada251-90c4-43bd-a811-ca9e2d43f9b7">
Nov 07 16:11:43 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 16:11:43 user nova-compute[75018]:         </nova:port>
Nov 07 16:11:43 user nova-compute[75018]:       </nova:ports>
Nov 07 16:11:43 user nova-compute[75018]:     </nova:instance>
Nov 07 16:11:43 user nova-compute[75018]:   </metadata>
Nov 07 16:11:43 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 16:11:43 user nova-compute[75018]:     <system>
Nov 07 16:11:43 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 16:11:43 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 16:11:43 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 16:11:43 user nova-compute[75018]:       <entry name="serial">088a647a-9091-4991-a763-11561d00db02</entry>
Nov 07 16:11:43 user nova-compute[75018]:       <entry name="uuid">088a647a-9091-4991-a763-11561d00db02</entry>
Nov 07 16:11:43 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 16:11:43 user nova-compute[75018]:     </system>
Nov 07 16:11:43 user nova-compute[75018]:   </sysinfo>
Nov 07 16:11:43 user nova-compute[75018]:   <os>
Nov 07 16:11:43 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 16:11:43 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 16:11:43 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 16:11:43 user nova-compute[75018]:   </os>
Nov 07 16:11:43 user nova-compute[75018]:   <features>
Nov 07 16:11:43 user nova-compute[75018]:     <acpi/>
Nov 07 16:11:43 user nova-compute[75018]:     <apic/>
Nov 07 16:11:43 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 16:11:43 user nova-compute[75018]:   </features>
Nov 07 16:11:43 user nova-compute[75018]:   <clock offset="utc">
Nov 07 16:11:43 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 16:11:43 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 16:11:43 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 16:11:43 user nova-compute[75018]:   </clock>
Nov 07 16:11:43 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 16:11:43 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 16:11:43 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 16:11:43 user nova-compute[75018]:   </cpu>
Nov 07 16:11:43 user nova-compute[75018]:   <devices>
Nov 07 16:11:43 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 16:11:43 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 16:11:43 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk"/>
Nov 07 16:11:43 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 16:11:43 user nova-compute[75018]:     </disk>
Nov 07 16:11:43 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 16:11:43 user nova-compute[75018]:       <mac address="fa:16:3e:b7:b2:86"/>
Nov 07 16:11:43 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 16:11:43 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 16:11:43 user nova-compute[75018]:       <target dev="tap2dada251-90"/>
Nov 07 16:11:43 user nova-compute[75018]:     </interface>
Nov 07 16:11:43 user nova-compute[75018]:     <serial type="pty">
Nov 07 16:11:43 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/console.log" append="off"/>
Nov 07 16:11:43 user nova-compute[75018]:     </serial>
Nov 07 16:11:43 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 16:11:43 user nova-compute[75018]:     <video>
Nov 07 16:11:43 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 16:11:43 user nova-compute[75018]:     </video>
Nov 07 16:11:43 user nova-compute[75018]:     <rng model="virtio">
Nov 07 16:11:43 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 16:11:43 user nova-compute[75018]:     </rng>
Nov 07 16:11:43 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 16:11:43 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 16:11:43 user nova-compute[75018]:       <stats period="10"/>
Nov 07 16:11:43 user nova-compute[75018]:     </memballoon>
Nov 07 16:11:43 user nova-compute[75018]:   </devices>
Nov 07 16:11:43 user nova-compute[75018]: </domain>
Nov 07 16:11:43 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-39183955',display_name='tempest-AttachVolumeNegativeTest-server-39183955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-39183955',id=49,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdbZZQeaP0VITKclWjFjqQYfSdOx0hx2iefU5GBUiR0egePGXtxo9aYj6r2Hmp/O/9gGwFMoXyTgDlHJg3dOvl65V3d6eXztlrNdYIQ0mHZnKh4rza2dAegx/vGkyiFwg==',key_name='tempest-keypair-916367005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757bf62aa5914b798354f519fcb931ab',ramdisk_id='',reservation_id='r-9cm7z490',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1198936328',owner_user_name='tempest-AttachVolumeNegativeTest-1198936328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T16:11:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98eb4211b01e424a9f185ab1db143e7a',uuid=088a647a-9091-4991-a763-11561d00db02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "address": "fa:16:3e:b7:b2:86", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dada251-90", "ovs_interfaceid": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converting VIF {"id": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "address": "fa:16:3e:b7:b2:86", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dada251-90", "ovs_interfaceid": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b2:86,bridge_name='br-int',has_traffic_filtering=True,id=2dada251-90c4-43bd-a811-ca9e2d43f9b7,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dada251-90') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG os_vif [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b2:86,bridge_name='br-int',has_traffic_filtering=True,id=2dada251-90c4-43bd-a811-ca9e2d43f9b7,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dada251-90') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8d7760f-4f83-5976-92d9-cc9eba859bd9', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dada251-90, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dada251-90, col_values=(('qos', UUID('8e328c83-b77c-466f-b890-77261a61c2c0')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dada251-90, col_values=(('external_ids', {'iface-id': '2dada251-90c4-43bd-a811-ca9e2d43f9b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:b2:86', 'vm-uuid': '088a647a-9091-4991-a763-11561d00db02'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:43 user nova-compute[75018]: INFO os_vif [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b2:86,bridge_name='br-int',has_traffic_filtering=True,id=2dada251-90c4-43bd-a811-ca9e2d43f9b7,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dada251-90')
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 16:11:43 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No VIF found with MAC fa:16:3e:b7:b2:86, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 16:11:44 user nova-compute[75018]: DEBUG nova.network.neutron [req-6a3b2533-43ee-4e07-9136-327333b69090 req-5bb0aafc-308c-4395-961b-2c483ad5af83 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Updated VIF entry in instance network info cache for port 2dada251-90c4-43bd-a811-ca9e2d43f9b7. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 16:11:44 user nova-compute[75018]: DEBUG nova.network.neutron [req-6a3b2533-43ee-4e07-9136-327333b69090 req-5bb0aafc-308c-4395-961b-2c483ad5af83 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Updating instance_info_cache with network_info: [{"id": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "address": "fa:16:3e:b7:b2:86", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dada251-90", "ovs_interfaceid": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:11:44 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6a3b2533-43ee-4e07-9136-327333b69090 req-5bb0aafc-308c-4395-961b-2c483ad5af83 service nova] Releasing lock "refresh_cache-088a647a-9091-4991-a763-11561d00db02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-2360163c-9ddc-4c54-bcaa-698a8005888b req-9a765de4-adf0-4369-8517-734cdb0ec6a9 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Received event network-vif-plugged-2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2360163c-9ddc-4c54-bcaa-698a8005888b req-9a765de4-adf0-4369-8517-734cdb0ec6a9 service nova] Acquiring lock "088a647a-9091-4991-a763-11561d00db02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2360163c-9ddc-4c54-bcaa-698a8005888b req-9a765de4-adf0-4369-8517-734cdb0ec6a9 service nova] Lock "088a647a-9091-4991-a763-11561d00db02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2360163c-9ddc-4c54-bcaa-698a8005888b req-9a765de4-adf0-4369-8517-734cdb0ec6a9 service nova] Lock "088a647a-9091-4991-a763-11561d00db02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-2360163c-9ddc-4c54-bcaa-698a8005888b req-9a765de4-adf0-4369-8517-734cdb0ec6a9 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] No waiting events found dispatching network-vif-plugged-2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:11:45 user nova-compute[75018]: WARNING nova.compute.manager [req-2360163c-9ddc-4c54-bcaa-698a8005888b req-9a765de4-adf0-4369-8517-734cdb0ec6a9 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Received unexpected event network-vif-plugged-2dada251-90c4-43bd-a811-ca9e2d43f9b7 for instance with vm_state building and task_state spawning.
Nov 07 16:11:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-2360163c-9ddc-4c54-bcaa-698a8005888b req-9a765de4-adf0-4369-8517-734cdb0ec6a9 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Received event network-vif-plugged-2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2360163c-9ddc-4c54-bcaa-698a8005888b req-9a765de4-adf0-4369-8517-734cdb0ec6a9 service nova] Acquiring lock "088a647a-9091-4991-a763-11561d00db02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2360163c-9ddc-4c54-bcaa-698a8005888b req-9a765de4-adf0-4369-8517-734cdb0ec6a9 service nova] Lock "088a647a-9091-4991-a763-11561d00db02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2360163c-9ddc-4c54-bcaa-698a8005888b req-9a765de4-adf0-4369-8517-734cdb0ec6a9 service nova] Lock "088a647a-9091-4991-a763-11561d00db02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:11:45 user nova-compute[75018]: DEBUG nova.compute.manager [req-2360163c-9ddc-4c54-bcaa-698a8005888b req-9a765de4-adf0-4369-8517-734cdb0ec6a9 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] No waiting events found dispatching network-vif-plugged-2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:11:45 user nova-compute[75018]: WARNING nova.compute.manager [req-2360163c-9ddc-4c54-bcaa-698a8005888b req-9a765de4-adf0-4369-8517-734cdb0ec6a9 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Received unexpected event network-vif-plugged-2dada251-90c4-43bd-a811-ca9e2d43f9b7 for instance with vm_state building and task_state spawning.
Nov 07 16:11:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 16:11:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 16:11:47 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 088a647a-9091-4991-a763-11561d00db02] Instance spawned successfully.
Nov 07 16:11:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 16:11:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:11:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:11:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:11:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:11:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:11:47 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:11:47 user nova-compute[75018]: INFO nova.compute.manager [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 07 16:11:47 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 16:11:47 user nova-compute[75018]: INFO nova.compute.manager [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Took 5.79 seconds to build instance.
Nov 07 16:11:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e2d0f53f-278e-49e2-b365-b8ff8b3785bf tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "088a647a-9091-4991-a763-11561d00db02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.884s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:11:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:11:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:11:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:11:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:11:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:11:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:57 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:11:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:11:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:11:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:11:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:11:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:11:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:12:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:12:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 16:12:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] There are 0 instances to clean {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 16:12:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:02 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:12:02 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:12:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:05 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:12:05 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:12:05 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:12:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:12:05 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:12:05 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:12:05 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid a24b7d67-64e5-4051-addb-28afde08f08d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:12:06 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updating instance_info_cache with network_info: [{"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:12:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:12:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:12:06 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:12:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:12:06 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:12:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75018) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 16:12:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:12:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:12:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:10 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:12:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:12:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:12:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:12:10 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:12:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:12:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:12:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:12:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:12:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:12:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:12:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:12:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:12:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:12:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:11 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:12:11 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:12:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8815MB free_disk=24.850452423095703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:12:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:12:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:12:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance a24b7d67-64e5-4051-addb-28afde08f08d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:12:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 088a647a-9091-4991-a763-11561d00db02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:12:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:12:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:12:12 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing inventories for resource provider 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 16:12:12 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating ProviderTree inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 16:12:12 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 16:12:12 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing aggregate associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, aggregates: None {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 16:12:12 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing trait associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 16:12:12 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:12:12 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:12:12 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:12:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:12:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:12:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:12:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:12:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:12:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:12:24 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:12:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:12:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:12:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:12:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:12:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:12:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:12:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:12:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:12:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:12:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:12:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:12:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:12:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:12:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:12:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:12:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:12:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:12:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:12:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:12:58 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:12:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:02 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:13:03 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:13:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:13:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:13:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:13:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:13:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:04 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:13:06 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:13:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:13:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-088a647a-9091-4991-a763-11561d00db02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:13:06 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-088a647a-9091-4991-a763-11561d00db02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:13:06 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 088a647a-9091-4991-a763-11561d00db02] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:13:07 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 088a647a-9091-4991-a763-11561d00db02] Updating instance_info_cache with network_info: [{"id": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "address": "fa:16:3e:b7:b2:86", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dada251-90", "ovs_interfaceid": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:13:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-088a647a-9091-4991-a763-11561d00db02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:13:07 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: 088a647a-9091-4991-a763-11561d00db02] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:13:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:13:07 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:13:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:13:08 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:13:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:13:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:13:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:13:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:13:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:10 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:13:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:13:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:13:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:13:10 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:13:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:13:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:13:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:13:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:13:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:13:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:13:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:13:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:13:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:13:11 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:13:11 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:13:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8883MB free_disk=24.849628448486328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:13:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:13:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:13:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance a24b7d67-64e5-4051-addb-28afde08f08d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:13:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance 088a647a-9091-4991-a763-11561d00db02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:13:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:13:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:13:12 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:13:12 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:13:12 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:13:12 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:13:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:13:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:21 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:13:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:13:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:13:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:13:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:13:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:13:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-a01fb470-0ef1-4688-b380-9a0457a351ab req-2b912665-d00f-40c5-bb16-303834f30ff5 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Received event network-changed-2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:13:32 user nova-compute[75018]: DEBUG nova.compute.manager [req-a01fb470-0ef1-4688-b380-9a0457a351ab req-2b912665-d00f-40c5-bb16-303834f30ff5 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Refreshing instance network info cache due to event network-changed-2dada251-90c4-43bd-a811-ca9e2d43f9b7. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 16:13:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a01fb470-0ef1-4688-b380-9a0457a351ab req-2b912665-d00f-40c5-bb16-303834f30ff5 service nova] Acquiring lock "refresh_cache-088a647a-9091-4991-a763-11561d00db02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:13:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a01fb470-0ef1-4688-b380-9a0457a351ab req-2b912665-d00f-40c5-bb16-303834f30ff5 service nova] Acquired lock "refresh_cache-088a647a-9091-4991-a763-11561d00db02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:13:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-a01fb470-0ef1-4688-b380-9a0457a351ab req-2b912665-d00f-40c5-bb16-303834f30ff5 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Refreshing network info cache for port 2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 16:13:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-a01fb470-0ef1-4688-b380-9a0457a351ab req-2b912665-d00f-40c5-bb16-303834f30ff5 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Updated VIF entry in instance network info cache for port 2dada251-90c4-43bd-a811-ca9e2d43f9b7. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 16:13:32 user nova-compute[75018]: DEBUG nova.network.neutron [req-a01fb470-0ef1-4688-b380-9a0457a351ab req-2b912665-d00f-40c5-bb16-303834f30ff5 service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Updating instance_info_cache with network_info: [{"id": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "address": "fa:16:3e:b7:b2:86", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dada251-90", "ovs_interfaceid": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:13:32 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-a01fb470-0ef1-4688-b380-9a0457a351ab req-2b912665-d00f-40c5-bb16-303834f30ff5 service nova] Releasing lock "refresh_cache-088a647a-9091-4991-a763-11561d00db02" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:13:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:13:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "088a647a-9091-4991-a763-11561d00db02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:13:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "088a647a-9091-4991-a763-11561d00db02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:13:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "088a647a-9091-4991-a763-11561d00db02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:13:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "088a647a-9091-4991-a763-11561d00db02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:13:33 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "088a647a-9091-4991-a763-11561d00db02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:13:33 user nova-compute[75018]: INFO nova.compute.manager [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Terminating instance
Nov 07 16:13:33 user nova-compute[75018]: DEBUG nova.compute.manager [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 16:13:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-211dcfd2-353f-4295-bf72-3244a2e16793 req-b4b072f1-0ada-4609-bb2a-009fb15ca50d service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Received event network-vif-unplugged-2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-211dcfd2-353f-4295-bf72-3244a2e16793 req-b4b072f1-0ada-4609-bb2a-009fb15ca50d service nova] Acquiring lock "088a647a-9091-4991-a763-11561d00db02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-211dcfd2-353f-4295-bf72-3244a2e16793 req-b4b072f1-0ada-4609-bb2a-009fb15ca50d service nova] Lock "088a647a-9091-4991-a763-11561d00db02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-211dcfd2-353f-4295-bf72-3244a2e16793 req-b4b072f1-0ada-4609-bb2a-009fb15ca50d service nova] Lock "088a647a-9091-4991-a763-11561d00db02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-211dcfd2-353f-4295-bf72-3244a2e16793 req-b4b072f1-0ada-4609-bb2a-009fb15ca50d service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] No waiting events found dispatching network-vif-unplugged-2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-211dcfd2-353f-4295-bf72-3244a2e16793 req-b4b072f1-0ada-4609-bb2a-009fb15ca50d service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Received event network-vif-unplugged-2dada251-90c4-43bd-a811-ca9e2d43f9b7 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-211dcfd2-353f-4295-bf72-3244a2e16793 req-b4b072f1-0ada-4609-bb2a-009fb15ca50d service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Received event network-vif-plugged-2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-211dcfd2-353f-4295-bf72-3244a2e16793 req-b4b072f1-0ada-4609-bb2a-009fb15ca50d service nova] Acquiring lock "088a647a-9091-4991-a763-11561d00db02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-211dcfd2-353f-4295-bf72-3244a2e16793 req-b4b072f1-0ada-4609-bb2a-009fb15ca50d service nova] Lock "088a647a-9091-4991-a763-11561d00db02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-211dcfd2-353f-4295-bf72-3244a2e16793 req-b4b072f1-0ada-4609-bb2a-009fb15ca50d service nova] Lock "088a647a-9091-4991-a763-11561d00db02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG nova.compute.manager [req-211dcfd2-353f-4295-bf72-3244a2e16793 req-b4b072f1-0ada-4609-bb2a-009fb15ca50d service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] No waiting events found dispatching network-vif-plugged-2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:13:34 user nova-compute[75018]: WARNING nova.compute.manager [req-211dcfd2-353f-4295-bf72-3244a2e16793 req-b4b072f1-0ada-4609-bb2a-009fb15ca50d service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Received unexpected event network-vif-plugged-2dada251-90c4-43bd-a811-ca9e2d43f9b7 for instance with vm_state active and task_state deleting.
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: 088a647a-9091-4991-a763-11561d00db02] Instance destroyed successfully.
Nov 07 16:13:34 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'resources' on Instance uuid 088a647a-9091-4991-a763-11561d00db02 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-39183955',display_name='tempest-AttachVolumeNegativeTest-server-39183955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-39183955',id=49,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdbZZQeaP0VITKclWjFjqQYfSdOx0hx2iefU5GBUiR0egePGXtxo9aYj6r2Hmp/O/9gGwFMoXyTgDlHJg3dOvl65V3d6eXztlrNdYIQ0mHZnKh4rza2dAegx/vGkyiFwg==',key_name='tempest-keypair-916367005',keypairs=<?>,launch_index=0,launched_at=2023-11-07T16:11:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='757bf62aa5914b798354f519fcb931ab',ramdisk_id='',reservation_id='r-9cm7z490',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1198936328',owner_user_name='tempest-AttachVolumeNegativeTest-1198936328-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T16:11:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98eb4211b01e424a9f185ab1db143e7a',uuid=088a647a-9091-4991-a763-11561d00db02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "address": "fa:16:3e:b7:b2:86", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dada251-90", "ovs_interfaceid": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converting VIF {"id": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "address": "fa:16:3e:b7:b2:86", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dada251-90", "ovs_interfaceid": "2dada251-90c4-43bd-a811-ca9e2d43f9b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b2:86,bridge_name='br-int',has_traffic_filtering=True,id=2dada251-90c4-43bd-a811-ca9e2d43f9b7,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dada251-90') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG os_vif [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b2:86,bridge_name='br-int',has_traffic_filtering=True,id=2dada251-90c4-43bd-a811-ca9e2d43f9b7,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dada251-90') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dada251-90, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e328c83-b77c-466f-b890-77261a61c2c0) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:13:34 user nova-compute[75018]: INFO os_vif [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b2:86,bridge_name='br-int',has_traffic_filtering=True,id=2dada251-90c4-43bd-a811-ca9e2d43f9b7,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dada251-90')
Nov 07 16:13:34 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Deleting instance files /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02_del
Nov 07 16:13:34 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Deletion of /opt/stack/data/nova/instances/088a647a-9091-4991-a763-11561d00db02_del complete
Nov 07 16:13:34 user nova-compute[75018]: INFO nova.compute.manager [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: 088a647a-9091-4991-a763-11561d00db02] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 07 16:13:34 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: 088a647a-9091-4991-a763-11561d00db02] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 088a647a-9091-4991-a763-11561d00db02] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:35 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: 088a647a-9091-4991-a763-11561d00db02] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:13:35 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: 088a647a-9091-4991-a763-11561d00db02] Took 0.67 seconds to deallocate network for instance.
Nov 07 16:13:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:13:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:13:35 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:13:35 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:13:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:13:35 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Deleted allocations for instance 088a647a-9091-4991-a763-11561d00db02
Nov 07 16:13:35 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3bdca140-6d76-4c28-bca1-45841ddf023f tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "088a647a-9091-4991-a763-11561d00db02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.645s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:13:36 user nova-compute[75018]: DEBUG nova.compute.manager [req-a745556d-6e97-402a-922d-463d9f08e852 req-d4955108-beca-4238-8697-5b0370dd5f1f service nova] [instance: 088a647a-9091-4991-a763-11561d00db02] Received event network-vif-deleted-2dada251-90c4-43bd-a811-ca9e2d43f9b7 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:13:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:13:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:13:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:13:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:13:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:13:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:13:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:13:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:13:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:13:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:13:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:13:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:13:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:13:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:13:59 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:14:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:14:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:14:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:14:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:14:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:14:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:14:04 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:14:04 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:14:04 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:14:06 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:14:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:14:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:14:07 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:14:07 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:14:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:14:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:14:07 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:14:07 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid a24b7d67-64e5-4051-addb-28afde08f08d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:14:08 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updating instance_info_cache with network_info: [{"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:14:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:14:08 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:14:08 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:14:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:14:09 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:14:10 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:14:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:14:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:14:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:14:10 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:14:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:14:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:14:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:14:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:14:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75018) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 16:14:11 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:14:11 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:14:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=24.876811981201172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:14:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:14:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:14:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance a24b7d67-64e5-4051-addb-28afde08f08d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:14:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:14:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:14:11 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:14:11 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:14:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:14:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:14:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:14:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:14:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:14:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:14:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "a24b7d67-64e5-4051-addb-28afde08f08d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:14:25 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "a24b7d67-64e5-4051-addb-28afde08f08d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:14:25 user nova-compute[75018]: INFO nova.compute.manager [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Detaching volume 3b4dad34-d055-4c86-8785-006532ee9cec
Nov 07 16:14:25 user nova-compute[75018]: INFO nova.virt.block_device [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Attempting to driver detach volume 3b4dad34-d055-4c86-8785-006532ee9cec from mountpoint /dev/vdb
Nov 07 16:14:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Attempting to detach device vdb from instance a24b7d67-64e5-4051-addb-28afde08f08d from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 16:14:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 16:14:25 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 16:14:25 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 16:14:25 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 16:14:25 user nova-compute[75018]:   <serial>3b4dad34-d055-4c86-8785-006532ee9cec</serial>
Nov 07 16:14:25 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 16:14:25 user nova-compute[75018]: </disk>
Nov 07 16:14:25 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 16:14:25 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Successfully detached device vdb from instance a24b7d67-64e5-4051-addb-28afde08f08d from the persistent domain config.
Nov 07 16:14:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a24b7d67-64e5-4051-addb-28afde08f08d from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 16:14:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 16:14:25 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 16:14:25 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 16:14:25 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 16:14:25 user nova-compute[75018]:   <serial>3b4dad34-d055-4c86-8785-006532ee9cec</serial>
Nov 07 16:14:25 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 16:14:25 user nova-compute[75018]: </disk>
Nov 07 16:14:25 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 16:14:25 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a24b7d67-64e5-4051-addb-28afde08f08d {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 16:14:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:14:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:14:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:14:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:14:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:14:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:14:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:14:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:14:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:14:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:14:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:14:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:14:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:14:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:14:45 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a24b7d67-64e5-4051-addb-28afde08f08d is timed out.
Nov 07 16:14:45 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Successfully detached device vdb from instance a24b7d67-64e5-4051-addb-28afde08f08d from the live domain config.
Nov 07 16:14:45 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 16:14:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgtOnYCo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 16:14:45 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:14:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:14:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:14:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:14:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:14:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fd2775-c5ec-420a-8a74-15038632cf87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:14:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 16:14:45 user nova-compute[75018]: No targets found.
Nov 07 16:14:45 user nova-compute[75018]: iSNS:
Nov 07 16:14:45 user nova-compute[75018]: No targets found.
Nov 07 16:14:45 user nova-compute[75018]: STATIC:
Nov 07 16:14:45 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec
Nov 07 16:14:45 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 16:14:45 user nova-compute[75018]:                 Iface Name: default
Nov 07 16:14:45 user nova-compute[75018]: FIRMWARE:
Nov 07 16:14:45 user nova-compute[75018]: No targets found.
Nov 07 16:14:45 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:14:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 16:14:45 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 16:14:45 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 16:14:45 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 16:14:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:14:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:14:45 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54f801d-b01a-4ab0-b6e6-ca96455bc66d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:14:45 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b585161-a8c0-4cc5-98b2-d93ce2231eab]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec (non-flash)
Nov 07 16:14:46 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec (non-flash)
Nov 07 16:14:46 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae04b0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d416e9-ea5a-4b30-9dee-927538787a37]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c547dbb-9161-4437-93aa-d2b8469e9742]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[027dc2d0-9c1e-4240-a6ec-384c5f8de834]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7657bb-ff7a-4be9-8404-24219edf1377]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[797bcff2-73fe-4381-9c8f-31957d5ec9c8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[efce5ca0-3ffe-4ddd-8d6b-febabefe4dce]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec, portal: 172.16.0.220,3260]
Nov 07 16:14:46 user nova-compute[75018]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec, portal: 172.16.0.220,3260] successful.
Nov 07 16:14:46 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4dad34-d055-4c86-8785-006532ee9cec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[779ac085-6f0d-45f2-b084-71dfb159e9a2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] <== disconnect_volume: return (288ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 16:14:46 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 16:14:47 user nova-compute[75018]: DEBUG nova.objects.instance [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'flavor' on Instance uuid a24b7d67-64e5-4051-addb-28afde08f08d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:14:47 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-414797a9-cfd6-44e2-a1c8-033d9a02889b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "a24b7d67-64e5-4051-addb-28afde08f08d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.760s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:14:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:14:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:14:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:14:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:14:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:14:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:14:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:14:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:14:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:14:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:14:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:14:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:14:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:01 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:15:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:15:05 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:15:06 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:15:06 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:15:06 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:15:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:15:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:15:07 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:15:07 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:15:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:15:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:15:07 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:15:07 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid a24b7d67-64e5-4051-addb-28afde08f08d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:15:08 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updating instance_info_cache with network_info: [{"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:15:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-a24b7d67-64e5-4051-addb-28afde08f08d" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:15:08 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:15:08 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:15:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:15:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:15:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:15:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:15:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:10 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:15:10 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:15:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:15:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:15:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:15:10 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:15:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:15:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:15:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:15:11 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:15:11 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:15:11 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:15:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=24.876075744628906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:15:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:15:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:15:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance a24b7d67-64e5-4051-addb-28afde08f08d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:15:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:15:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:15:11 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:15:11 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:15:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:15:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:15:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "a24b7d67-64e5-4051-addb-28afde08f08d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:15:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "a24b7d67-64e5-4051-addb-28afde08f08d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:15:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:15:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:15:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:15:15 user nova-compute[75018]: INFO nova.compute.manager [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Terminating instance
Nov 07 16:15:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 16:15:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:15 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-641c20ea-7302-43e5-9a24-e42f5957615d req-f8484571-0aa5-48e6-86e3-b3d67573a9ed service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Received event network-vif-unplugged-fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-641c20ea-7302-43e5-9a24-e42f5957615d req-f8484571-0aa5-48e6-86e3-b3d67573a9ed service nova] Acquiring lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-641c20ea-7302-43e5-9a24-e42f5957615d req-f8484571-0aa5-48e6-86e3-b3d67573a9ed service nova] Lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-641c20ea-7302-43e5-9a24-e42f5957615d req-f8484571-0aa5-48e6-86e3-b3d67573a9ed service nova] Lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-641c20ea-7302-43e5-9a24-e42f5957615d req-f8484571-0aa5-48e6-86e3-b3d67573a9ed service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] No waiting events found dispatching network-vif-unplugged-fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG nova.compute.manager [req-641c20ea-7302-43e5-9a24-e42f5957615d req-f8484571-0aa5-48e6-86e3-b3d67573a9ed service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Received event network-vif-unplugged-fba0da97-6901-452b-809f-e1294b964686 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:16 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Instance destroyed successfully.
Nov 07 16:15:16 user nova-compute[75018]: DEBUG nova.objects.instance [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'resources' on Instance uuid a24b7d67-64e5-4051-addb-28afde08f08d {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1391827290',display_name='tempest-AttachVolumeNegativeTest-server-1391827290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1391827290',id=48,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPV253lz00bwVAUkgtbMJ916CnWZ6AiAjm3MlMWqqd1wzhGZQBjLlbx2LW7ktyx3QIkwauXdPRaaDMv9OfO3NI5z5eKoP9MonqLot7DCmvtOjgNsLDQytrjWqFyNtPYdGA==',key_name='tempest-keypair-1395594798',keypairs=<?>,launch_index=0,launched_at=2023-11-07T16:09:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='757bf62aa5914b798354f519fcb931ab',ramdisk_id='',reservation_id='r-vc05x3uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1198936328',owner_user_name='tempest-AttachVolumeNegativeTest-1198936328-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T16:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98eb4211b01e424a9f185ab1db143e7a',uuid=a24b7d67-64e5-4051-addb-28afde08f08d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converting VIF {"id": "fba0da97-6901-452b-809f-e1294b964686", "address": "fa:16:3e:66:10:e3", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfba0da97-69", "ovs_interfaceid": "fba0da97-6901-452b-809f-e1294b964686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:10:e3,bridge_name='br-int',has_traffic_filtering=True,id=fba0da97-6901-452b-809f-e1294b964686,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba0da97-69') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG os_vif [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:10:e3,bridge_name='br-int',has_traffic_filtering=True,id=fba0da97-6901-452b-809f-e1294b964686,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba0da97-69') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfba0da97-69, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=136948c4-3ecc-4311-ba30-78d1b2d2184a) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:15:16 user nova-compute[75018]: INFO os_vif [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:10:e3,bridge_name='br-int',has_traffic_filtering=True,id=fba0da97-6901-452b-809f-e1294b964686,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfba0da97-69')
Nov 07 16:15:16 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Deleting instance files /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d_del
Nov 07 16:15:16 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Deletion of /opt/stack/data/nova/instances/a24b7d67-64e5-4051-addb-28afde08f08d_del complete
Nov 07 16:15:16 user nova-compute[75018]: INFO nova.compute.manager [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 07 16:15:16 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 16:15:16 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 16:15:17 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:15:17 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Took 0.66 seconds to deallocate network for instance.
Nov 07 16:15:17 user nova-compute[75018]: DEBUG nova.compute.manager [req-b3f3ab5d-dd8c-4a2d-b03f-9abd57278487 req-d835de12-4c85-44a0-8d22-87cf5c6b372d service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Received event network-vif-deleted-fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:15:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:15:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:15:17 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:15:17 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:15:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:15:17 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Deleted allocations for instance a24b7d67-64e5-4051-addb-28afde08f08d
Nov 07 16:15:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-77040b85-a119-431d-bfcf-4b3b609e140c tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "a24b7d67-64e5-4051-addb-28afde08f08d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.043s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:15:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-2dd975f5-4231-443f-9270-d3d5121906bf req-858ef90e-a8f7-4e9f-8499-f041b5ab054f service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Received event network-vif-plugged-fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:15:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2dd975f5-4231-443f-9270-d3d5121906bf req-858ef90e-a8f7-4e9f-8499-f041b5ab054f service nova] Acquiring lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:15:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2dd975f5-4231-443f-9270-d3d5121906bf req-858ef90e-a8f7-4e9f-8499-f041b5ab054f service nova] Lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:15:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-2dd975f5-4231-443f-9270-d3d5121906bf req-858ef90e-a8f7-4e9f-8499-f041b5ab054f service nova] Lock "a24b7d67-64e5-4051-addb-28afde08f08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:15:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-2dd975f5-4231-443f-9270-d3d5121906bf req-858ef90e-a8f7-4e9f-8499-f041b5ab054f service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] No waiting events found dispatching network-vif-plugged-fba0da97-6901-452b-809f-e1294b964686 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:15:18 user nova-compute[75018]: WARNING nova.compute.manager [req-2dd975f5-4231-443f-9270-d3d5121906bf req-858ef90e-a8f7-4e9f-8499-f041b5ab054f service nova] [instance: a24b7d67-64e5-4051-addb-28afde08f08d] Received unexpected event network-vif-plugged-fba0da97-6901-452b-809f-e1294b964686 for instance with vm_state deleted and task_state None.
Nov 07 16:15:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:22 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:15:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:15:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:15:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:15:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:15:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:15:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:15:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:15:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:15:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:15:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:15:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:15:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:15:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:15:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:15:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:15:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:15:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:15:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:15:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:15:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:15:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:15:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:15:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:15:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:15:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:15:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:01 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:16:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:06 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:16:06 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:16:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:16:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:16:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:16:07 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:16:07 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:16:07 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 16:16:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:16:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "fb9c516c-282c-49e3-a8f2-79be544540cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:16:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:16:09 user nova-compute[75018]: DEBUG nova.compute.manager [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 16:16:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:16:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:16:09 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 16:16:09 user nova-compute[75018]: INFO nova.compute.claims [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Claim successful on node user
Nov 07 16:16:09 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:16:09 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:16:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:16:09 user nova-compute[75018]: DEBUG nova.compute.manager [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 16:16:09 user nova-compute[75018]: DEBUG nova.compute.manager [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 16:16:09 user nova-compute[75018]: DEBUG nova.network.neutron [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 16:16:09 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 16:16:09 user nova-compute[75018]: DEBUG nova.compute.manager [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG nova.policy [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98eb4211b01e424a9f185ab1db143e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757bf62aa5914b798354f519fcb931ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG nova.compute.manager [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 16:16:10 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Creating image(s)
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "/opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "/opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.190s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk 1073741824" returned: 0 in 0.051s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG nova.network.neutron [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Successfully created port: 525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.178s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Cannot resize image /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Ensure instance console log exists: /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:16:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.network.neutron [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Successfully updated port: 525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquired lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.network.neutron [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-6a1f06a9-17b8-4669-aea6-646e7f47a4c1 req-fb24e823-80a9-4be9-afe3-4e21a7b4434f service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Received event network-changed-525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.compute.manager [req-6a1f06a9-17b8-4669-aea6-646e7f47a4c1 req-fb24e823-80a9-4be9-afe3-4e21a7b4434f service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Refreshing instance network info cache due to event network-changed-525dab78-daa8-439e-8c5f-65edb2fd42d4. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6a1f06a9-17b8-4669-aea6-646e7f47a4c1 req-fb24e823-80a9-4be9-afe3-4e21a7b4434f service nova] Acquiring lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.network.neutron [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.network.neutron [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Updating instance_info_cache with network_info: [{"id": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "address": "fa:16:3e:50:cf:a5", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525dab78-da", "ovs_interfaceid": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Releasing lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Instance network_info: |[{"id": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "address": "fa:16:3e:50:cf:a5", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525dab78-da", "ovs_interfaceid": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6a1f06a9-17b8-4669-aea6-646e7f47a4c1 req-fb24e823-80a9-4be9-afe3-4e21a7b4434f service nova] Acquired lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.network.neutron [req-6a1f06a9-17b8-4669-aea6-646e7f47a4c1 req-fb24e823-80a9-4be9-afe3-4e21a7b4434f service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Refreshing network info cache for port 525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Start _get_guest_xml network_info=[{"id": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "address": "fa:16:3e:50:cf:a5", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525dab78-da", "ovs_interfaceid": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 16:16:11 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:16:11 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1209926161',display_name='tempest-AttachVolumeNegativeTest-server-1209926161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1209926161',id=50,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHbPdsEuPT2J/1E1MGPTn8btdPlQ6IPmUmSd0wqvKsPmcoGaAJlC4q3wOZTAV6YgLzz4u7TFYyARsAMCKcF31q7HHoV6hh4NkLXIpzTFSbo1FKSnXGUr2fquTqG5a7rGQ==',key_name='tempest-keypair-638197544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757bf62aa5914b798354f519fcb931ab',ramdisk_id='',reservation_id='r-9devkbnp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1198936328',owner_user_name='tempest-AttachVolumeNegativeTest-1198936328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T16:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98eb4211b01e424a9f185ab1db143e7a',uuid=fb9c516c-282c-49e3-a8f2-79be544540cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "address": "fa:16:3e:50:cf:a5", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525dab78-da", "ovs_interfaceid": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converting VIF {"id": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "address": "fa:16:3e:50:cf:a5", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525dab78-da", "ovs_interfaceid": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:cf:a5,bridge_name='br-int',has_traffic_filtering=True,id=525dab78-daa8-439e-8c5f-65edb2fd42d4,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525dab78-da') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.objects.instance [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'pci_devices' on Instance uuid fb9c516c-282c-49e3-a8f2-79be544540cf {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] End _get_guest_xml xml=<domain type="kvm">
Nov 07 16:16:11 user nova-compute[75018]:   <uuid>fb9c516c-282c-49e3-a8f2-79be544540cf</uuid>
Nov 07 16:16:11 user nova-compute[75018]:   <name>instance-00000032</name>
Nov 07 16:16:11 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 16:16:11 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 16:16:11 user nova-compute[75018]:   <metadata>
Nov 07 16:16:11 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 16:16:11 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 16:16:11 user nova-compute[75018]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1209926161</nova:name>
Nov 07 16:16:11 user nova-compute[75018]:       <nova:creationTime>2023-11-07 16:16:11</nova:creationTime>
Nov 07 16:16:11 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 16:16:11 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 16:16:11 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 16:16:11 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 16:16:11 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 16:16:11 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 16:16:11 user nova-compute[75018]:       </nova:flavor>
Nov 07 16:16:11 user nova-compute[75018]:       <nova:owner>
Nov 07 16:16:11 user nova-compute[75018]:         <nova:user uuid="98eb4211b01e424a9f185ab1db143e7a">tempest-AttachVolumeNegativeTest-1198936328-project-member</nova:user>
Nov 07 16:16:11 user nova-compute[75018]:         <nova:project uuid="757bf62aa5914b798354f519fcb931ab">tempest-AttachVolumeNegativeTest-1198936328</nova:project>
Nov 07 16:16:11 user nova-compute[75018]:       </nova:owner>
Nov 07 16:16:11 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 16:16:11 user nova-compute[75018]:       <nova:ports>
Nov 07 16:16:11 user nova-compute[75018]:         <nova:port uuid="525dab78-daa8-439e-8c5f-65edb2fd42d4">
Nov 07 16:16:11 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 16:16:11 user nova-compute[75018]:         </nova:port>
Nov 07 16:16:11 user nova-compute[75018]:       </nova:ports>
Nov 07 16:16:11 user nova-compute[75018]:     </nova:instance>
Nov 07 16:16:11 user nova-compute[75018]:   </metadata>
Nov 07 16:16:11 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 16:16:11 user nova-compute[75018]:     <system>
Nov 07 16:16:11 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 16:16:11 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 16:16:11 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 16:16:11 user nova-compute[75018]:       <entry name="serial">fb9c516c-282c-49e3-a8f2-79be544540cf</entry>
Nov 07 16:16:11 user nova-compute[75018]:       <entry name="uuid">fb9c516c-282c-49e3-a8f2-79be544540cf</entry>
Nov 07 16:16:11 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 16:16:11 user nova-compute[75018]:     </system>
Nov 07 16:16:11 user nova-compute[75018]:   </sysinfo>
Nov 07 16:16:11 user nova-compute[75018]:   <os>
Nov 07 16:16:11 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 16:16:11 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 16:16:11 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 16:16:11 user nova-compute[75018]:   </os>
Nov 07 16:16:11 user nova-compute[75018]:   <features>
Nov 07 16:16:11 user nova-compute[75018]:     <acpi/>
Nov 07 16:16:11 user nova-compute[75018]:     <apic/>
Nov 07 16:16:11 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 16:16:11 user nova-compute[75018]:   </features>
Nov 07 16:16:11 user nova-compute[75018]:   <clock offset="utc">
Nov 07 16:16:11 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 16:16:11 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 16:16:11 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 16:16:11 user nova-compute[75018]:   </clock>
Nov 07 16:16:11 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 16:16:11 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 16:16:11 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 16:16:11 user nova-compute[75018]:   </cpu>
Nov 07 16:16:11 user nova-compute[75018]:   <devices>
Nov 07 16:16:11 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 16:16:11 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 16:16:11 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk"/>
Nov 07 16:16:11 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 16:16:11 user nova-compute[75018]:     </disk>
Nov 07 16:16:11 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 16:16:11 user nova-compute[75018]:       <mac address="fa:16:3e:50:cf:a5"/>
Nov 07 16:16:11 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 16:16:11 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 16:16:11 user nova-compute[75018]:       <target dev="tap525dab78-da"/>
Nov 07 16:16:11 user nova-compute[75018]:     </interface>
Nov 07 16:16:11 user nova-compute[75018]:     <serial type="pty">
Nov 07 16:16:11 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/console.log" append="off"/>
Nov 07 16:16:11 user nova-compute[75018]:     </serial>
Nov 07 16:16:11 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 16:16:11 user nova-compute[75018]:     <video>
Nov 07 16:16:11 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 16:16:11 user nova-compute[75018]:     </video>
Nov 07 16:16:11 user nova-compute[75018]:     <rng model="virtio">
Nov 07 16:16:11 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 16:16:11 user nova-compute[75018]:     </rng>
Nov 07 16:16:11 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 16:16:11 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 16:16:11 user nova-compute[75018]:       <stats period="10"/>
Nov 07 16:16:11 user nova-compute[75018]:     </memballoon>
Nov 07 16:16:11 user nova-compute[75018]:   </devices>
Nov 07 16:16:11 user nova-compute[75018]: </domain>
Nov 07 16:16:11 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1209926161',display_name='tempest-AttachVolumeNegativeTest-server-1209926161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1209926161',id=50,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHbPdsEuPT2J/1E1MGPTn8btdPlQ6IPmUmSd0wqvKsPmcoGaAJlC4q3wOZTAV6YgLzz4u7TFYyARsAMCKcF31q7HHoV6hh4NkLXIpzTFSbo1FKSnXGUr2fquTqG5a7rGQ==',key_name='tempest-keypair-638197544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757bf62aa5914b798354f519fcb931ab',ramdisk_id='',reservation_id='r-9devkbnp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1198936328',owner_user_name='tempest-AttachVolumeNegativeTest-1198936328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T16:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98eb4211b01e424a9f185ab1db143e7a',uuid=fb9c516c-282c-49e3-a8f2-79be544540cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "address": "fa:16:3e:50:cf:a5", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525dab78-da", "ovs_interfaceid": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converting VIF {"id": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "address": "fa:16:3e:50:cf:a5", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525dab78-da", "ovs_interfaceid": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:cf:a5,bridge_name='br-int',has_traffic_filtering=True,id=525dab78-daa8-439e-8c5f-65edb2fd42d4,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525dab78-da') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG os_vif [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:cf:a5,bridge_name='br-int',has_traffic_filtering=True,id=525dab78-daa8-439e-8c5f-65edb2fd42d4,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525dab78-da') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19fc8391-5b72-55c8-a3a4-6993d7fa0ecf', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap525dab78-da, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap525dab78-da, col_values=(('qos', UUID('d1d63e95-6846-4e32-9c0f-e122161d1c82')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap525dab78-da, col_values=(('external_ids', {'iface-id': '525dab78-daa8-439e-8c5f-65edb2fd42d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:cf:a5', 'vm-uuid': 'fb9c516c-282c-49e3-a8f2-79be544540cf'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:11 user nova-compute[75018]: INFO os_vif [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:cf:a5,bridge_name='br-int',has_traffic_filtering=True,id=525dab78-daa8-439e-8c5f-65edb2fd42d4,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525dab78-da')
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No VIF found with MAC fa:16:3e:50:cf:a5, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.network.neutron [req-6a1f06a9-17b8-4669-aea6-646e7f47a4c1 req-fb24e823-80a9-4be9-afe3-4e21a7b4434f service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Updated VIF entry in instance network info cache for port 525dab78-daa8-439e-8c5f-65edb2fd42d4. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG nova.network.neutron [req-6a1f06a9-17b8-4669-aea6-646e7f47a4c1 req-fb24e823-80a9-4be9-afe3-4e21a7b4434f service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Updating instance_info_cache with network_info: [{"id": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "address": "fa:16:3e:50:cf:a5", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525dab78-da", "ovs_interfaceid": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:16:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6a1f06a9-17b8-4669-aea6-646e7f47a4c1 req-fb24e823-80a9-4be9-afe3-4e21a7b4434f service nova] Releasing lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:16:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:12 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-1a8c2fcd-7ec6-4234-8d71-8d0de4f0343a req-22267dc7-126e-41d4-b8b1-f9277d329542 service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Received event network-vif-plugged-525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:16:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1a8c2fcd-7ec6-4234-8d71-8d0de4f0343a req-22267dc7-126e-41d4-b8b1-f9277d329542 service nova] Acquiring lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:16:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1a8c2fcd-7ec6-4234-8d71-8d0de4f0343a req-22267dc7-126e-41d4-b8b1-f9277d329542 service nova] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:16:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-1a8c2fcd-7ec6-4234-8d71-8d0de4f0343a req-22267dc7-126e-41d4-b8b1-f9277d329542 service nova] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:16:13 user nova-compute[75018]: DEBUG nova.compute.manager [req-1a8c2fcd-7ec6-4234-8d71-8d0de4f0343a req-22267dc7-126e-41d4-b8b1-f9277d329542 service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] No waiting events found dispatching network-vif-plugged-525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:16:13 user nova-compute[75018]: WARNING nova.compute.manager [req-1a8c2fcd-7ec6-4234-8d71-8d0de4f0343a req-22267dc7-126e-41d4-b8b1-f9277d329542 service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Received unexpected event network-vif-plugged-525dab78-daa8-439e-8c5f-65edb2fd42d4 for instance with vm_state building and task_state spawning.
Nov 07 16:16:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:16:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:16:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:16:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:16:14 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:16:14 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:16:14 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=9109MB free_disk=24.902523040771484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:16:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:16:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:16:14 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fb9c516c-282c-49e3-a8f2-79be544540cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:16:14 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:16:14 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:16:14 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:16:14 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:16:14 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:16:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 16:16:15 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Instance spawned successfully.
Nov 07 16:16:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG nova.compute.manager [req-6fa517d2-4375-4140-8879-e25e1ac1605d req-033605dc-b2dc-4c3e-9a06-c51c4b4fe955 service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Received event network-vif-plugged-525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6fa517d2-4375-4140-8879-e25e1ac1605d req-033605dc-b2dc-4c3e-9a06-c51c4b4fe955 service nova] Acquiring lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6fa517d2-4375-4140-8879-e25e1ac1605d req-033605dc-b2dc-4c3e-9a06-c51c4b4fe955 service nova] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6fa517d2-4375-4140-8879-e25e1ac1605d req-033605dc-b2dc-4c3e-9a06-c51c4b4fe955 service nova] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG nova.compute.manager [req-6fa517d2-4375-4140-8879-e25e1ac1605d req-033605dc-b2dc-4c3e-9a06-c51c4b4fe955 service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] No waiting events found dispatching network-vif-plugged-525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:16:15 user nova-compute[75018]: WARNING nova.compute.manager [req-6fa517d2-4375-4140-8879-e25e1ac1605d req-033605dc-b2dc-4c3e-9a06-c51c4b4fe955 service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Received unexpected event network-vif-plugged-525dab78-daa8-439e-8c5f-65edb2fd42d4 for instance with vm_state building and task_state spawning.
Nov 07 16:16:15 user nova-compute[75018]: INFO nova.compute.manager [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 07 16:16:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:16:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:16:15 user nova-compute[75018]: INFO nova.compute.manager [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Took 5.68 seconds to build instance.
Nov 07 16:16:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-70c7a36b-91c2-46ea-8ae0-7d84bfdbff8b tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.781s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:16:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:16:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:16:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:16:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:16:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:16:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:16:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:16:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:16:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:16:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:17:00 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:17:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 16:17:00 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] There are 0 instances to clean {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 16:17:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:17:03 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:17:06 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:17:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:17:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:17:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:17:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:17:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:17:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:17:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:17:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:17:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:17:07 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:17:07 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:17:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:17:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:17:07 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:17:07 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid fb9c516c-282c-49e3-a8f2-79be544540cf {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:17:08 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Updating instance_info_cache with network_info: [{"id": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "address": "fa:16:3e:50:cf:a5", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525dab78-da", "ovs_interfaceid": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:17:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:17:08 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:17:08 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:17:08 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:17:10 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:17:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:17:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:17:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:17:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:17:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:17:13 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:17:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:17:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:17:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:17:14 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:17:14 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:17:14 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8966MB free_disk=24.873470306396484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fb9c516c-282c-49e3-a8f2-79be544540cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing inventories for resource provider 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating ProviderTree inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing aggregate associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, aggregates: None {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing trait associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:17:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:17:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:17:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:17:20 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:17:20 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75018) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 16:17:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:17:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:17:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:17:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:17:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:17:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:17:23 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:17:25 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:17:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:17:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:17:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:17:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:17:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:17:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:17:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:17:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:17:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:17:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:17:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:17:52 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:17:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-fd8a9a62-89b8-4910-b515-1ed4fa7ac686 req-49792670-cebd-477f-9492-dc46270813eb service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Received event network-changed-525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:18:00 user nova-compute[75018]: DEBUG nova.compute.manager [req-fd8a9a62-89b8-4910-b515-1ed4fa7ac686 req-49792670-cebd-477f-9492-dc46270813eb service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Refreshing instance network info cache due to event network-changed-525dab78-daa8-439e-8c5f-65edb2fd42d4. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 16:18:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fd8a9a62-89b8-4910-b515-1ed4fa7ac686 req-49792670-cebd-477f-9492-dc46270813eb service nova] Acquiring lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:18:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fd8a9a62-89b8-4910-b515-1ed4fa7ac686 req-49792670-cebd-477f-9492-dc46270813eb service nova] Acquired lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:18:00 user nova-compute[75018]: DEBUG nova.network.neutron [req-fd8a9a62-89b8-4910-b515-1ed4fa7ac686 req-49792670-cebd-477f-9492-dc46270813eb service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Refreshing network info cache for port 525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 16:18:00 user nova-compute[75018]: DEBUG nova.network.neutron [req-fd8a9a62-89b8-4910-b515-1ed4fa7ac686 req-49792670-cebd-477f-9492-dc46270813eb service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Updated VIF entry in instance network info cache for port 525dab78-daa8-439e-8c5f-65edb2fd42d4. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 16:18:00 user nova-compute[75018]: DEBUG nova.network.neutron [req-fd8a9a62-89b8-4910-b515-1ed4fa7ac686 req-49792670-cebd-477f-9492-dc46270813eb service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Updating instance_info_cache with network_info: [{"id": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "address": "fa:16:3e:50:cf:a5", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525dab78-da", "ovs_interfaceid": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:18:00 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-fd8a9a62-89b8-4910-b515-1ed4fa7ac686 req-49792670-cebd-477f-9492-dc46270813eb service nova] Releasing lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:18:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:18:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:18:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:18:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:18:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:04 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:18:06 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:18:06 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:18:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "fb9c516c-282c-49e3-a8f2-79be544540cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG nova.objects.instance [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'flavor' on Instance uuid fb9c516c-282c-49e3-a8f2-79be544540cf {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "fb9c516c-282c-49e3-a8f2-79be544540cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:18:07 user nova-compute[75018]: INFO nova.compute.manager [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Attaching volume 31ef22ce-3093-4374-9ea6-a2b6c10e676e to /dev/vdb
Nov 07 16:18:07 user nova-compute[75018]: DEBUG os_brick.utils [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f93229-c9f1-4fea-9c77-ce8a7088761b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e1d78b-7ee5-4530-ac98-011b07380932]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e71bf0-7d0f-4dd6-9614-ec95acd93b32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[df37a5d7-aa57-4641-aba3-3b89d85a4355]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 16:18:07 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 16:18:07 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d268ff24-d274-4f18-b707-d662e01fabee]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG os_brick.utils [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 16:18:07 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Updating existing volume attachment record: cb90b199-a6d0-4cb8-a159-b327d2c440a5 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 16:18:08 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:18:09 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:18:09 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:18:09 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:18:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:18:09 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:18:09 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:18:09 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid fb9c516c-282c-49e3-a8f2-79be544540cf {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:18:10 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Updating instance_info_cache with network_info: [{"id": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "address": "fa:16:3e:50:cf:a5", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525dab78-da", "ovs_interfaceid": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:18:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:18:10 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:18:10 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:18:11 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:18:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:18:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:18:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:18:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:18:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:18:15 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:18:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:16 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:18:16 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:18:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=24.872638702392578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:18:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:18:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:18:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fb9c516c-282c-49e3-a8f2-79be544540cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:18:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:18:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:18:16 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:18:16 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:18:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:18:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:18:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:18:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:18:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:18:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:18:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSvRzVFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 16:18:28 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:18:28 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:18:28 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4dc530-5535-4eee-9480-e1d563a13739]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 16:18:28 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[08672109-ea56-430c-8e6a-861935798214]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e] added
Nov 07 16:18:28 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9146138e-8278-4028-82a0-d94a5e6e7f55]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0e7c4a-f420-4610-8937-5a9bf6814bd1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xSvRzVFb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xSvRzVFb" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[42be4d97-b208-4cdf-810f-8a936d24f70f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xSvRzVFb'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7648221-5ffb-49ef-9a72-a8088cab1da6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38501ba-5549-4b84-9d4b-ca9ff93238d8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 16:18:28 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 16:18:28 user nova-compute[75018]:  {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 16:18:28 user nova-compute[75018]: WARNING os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 16:18:28 user nova-compute[75018]: 
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecabfc54-90a8-43c3-bdda-e24fc32e18e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e, portal: 172.16.0.220,3260]
Nov 07 16:18:28 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e, portal: 172.16.0.220,3260] successful.
Nov 07 16:18:28 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c849b5-39f2-4a5f-a592-84cd20cf9d43]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bcb9d3-76a7-4c87-8b84-c05397494ce1]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e (non-flash)
Nov 07 16:18:28 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e (non-flash)
Nov 07 16:18:28 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70097b7-e004-4e04-8aac-b1f406b60ab7]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 16:18:28 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSvRzVFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 16:18:29 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:18:29 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23136333332643131', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 16:18:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136333332643131', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 16:18:29 user nova-compute[75018]: DEBUG nova.objects.instance [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'flavor' on Instance uuid fb9c516c-282c-49e3-a8f2-79be544540cf {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:18:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 16:18:29 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 16:18:29 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 16:18:29 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 16:18:29 user nova-compute[75018]:   <serial>31ef22ce-3093-4374-9ea6-a2b6c10e676e</serial>
Nov 07 16:18:29 user nova-compute[75018]: </disk>
Nov 07 16:18:29 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 16:18:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 16:18:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 16:18:29 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No VIF found with MAC fa:16:3e:50:cf:a5, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 16:18:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-0750b06e-ce46-436b-82b3-cf9ad4fe4a44 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.546s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:18:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:18:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:18:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:18:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:18:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:31 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "fb9c516c-282c-49e3-a8f2-79be544540cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:18:31 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:18:31 user nova-compute[75018]: INFO nova.compute.manager [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Detaching volume 31ef22ce-3093-4374-9ea6-a2b6c10e676e
Nov 07 16:18:32 user nova-compute[75018]: INFO nova.virt.block_device [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Attempting to driver detach volume 31ef22ce-3093-4374-9ea6-a2b6c10e676e from mountpoint /dev/vdb
Nov 07 16:18:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Attempting to detach device vdb from instance fb9c516c-282c-49e3-a8f2-79be544540cf from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 16:18:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 16:18:32 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 16:18:32 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 16:18:32 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 16:18:32 user nova-compute[75018]:   <serial>31ef22ce-3093-4374-9ea6-a2b6c10e676e</serial>
Nov 07 16:18:32 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 16:18:32 user nova-compute[75018]: </disk>
Nov 07 16:18:32 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 16:18:32 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Successfully detached device vdb from instance fb9c516c-282c-49e3-a8f2-79be544540cf from the persistent domain config.
Nov 07 16:18:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fb9c516c-282c-49e3-a8f2-79be544540cf from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 16:18:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 16:18:32 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 16:18:32 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 16:18:32 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 16:18:32 user nova-compute[75018]:   <serial>31ef22ce-3093-4374-9ea6-a2b6c10e676e</serial>
Nov 07 16:18:32 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 16:18:32 user nova-compute[75018]: </disk>
Nov 07 16:18:32 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 16:18:32 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fb9c516c-282c-49e3-a8f2-79be544540cf {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 16:18:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:37 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:18:37 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Triggering sync for uuid fb9c516c-282c-49e3-a8f2-79be544540cf {{(pid=75018) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 16:18:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "fb9c516c-282c-49e3-a8f2-79be544540cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:18:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:18:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:18:52 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fb9c516c-282c-49e3-a8f2-79be544540cf is timed out.
Nov 07 16:18:52 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Successfully detached device vdb from instance fb9c516c-282c-49e3-a8f2-79be544540cf from the live domain config.
Nov 07 16:18:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSvRzVFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 16:18:52 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ca3b53-ee1f-4c50-b4cf-6639b86fff53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 16:18:52 user nova-compute[75018]: No targets found.
Nov 07 16:18:52 user nova-compute[75018]: iSNS:
Nov 07 16:18:52 user nova-compute[75018]: No targets found.
Nov 07 16:18:52 user nova-compute[75018]: STATIC:
Nov 07 16:18:52 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e
Nov 07 16:18:52 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 16:18:52 user nova-compute[75018]:                 Iface Name: default
Nov 07 16:18:52 user nova-compute[75018]: FIRMWARE:
Nov 07 16:18:52 user nova-compute[75018]: No targets found.
Nov 07 16:18:52 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 16:18:52 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 16:18:52 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50fe4ab-8012-4190-9142-90c473308c19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad7afe2-5528-4764-ac43-11b5932a272d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e (non-flash)
Nov 07 16:18:52 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e (non-flash)
Nov 07 16:18:52 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feaf82e5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ddebe0-4636-4bf6-8195-eb828b5ab64b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c9b959-b7fe-46ea-b187-e7f461ddb81c]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a09927-2c8d-44aa-b3b6-11576a6d2083]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8622ef42-af84-4d09-8641-55740ff57f1c]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f80d444-be78-4205-971d-7ff82537e83b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9de67d4-e28f-4bf5-af02-b6ba03d608d7]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e, portal: 172.16.0.220,3260]
Nov 07 16:18:52 user nova-compute[75018]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e, portal: 172.16.0.220,3260] successful.
Nov 07 16:18:52 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ef22ce-3093-4374-9ea6-a2b6c10e676e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[83937141-4b34-4e03-b4b4-17f8060cd81c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] <== disconnect_volume: return (284ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 16:18:52 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 16:18:53 user nova-compute[75018]: DEBUG nova.objects.instance [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'flavor' on Instance uuid fb9c516c-282c-49e3-a8f2-79be544540cf {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:18:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-106ec730-e277-43b8-a613-c151ce988c6d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.840s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:18:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.978s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:18:53 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:18:56 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:19:01 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:19:05 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:19:06 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:19:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:19:07 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:19:09 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:19:10 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:19:10 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:19:10 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:19:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:19:10 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:19:10 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:19:10 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid fb9c516c-282c-49e3-a8f2-79be544540cf {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:19:11 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Updating instance_info_cache with network_info: [{"id": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "address": "fa:16:3e:50:cf:a5", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525dab78-da", "ovs_interfaceid": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:19:11 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-fb9c516c-282c-49e3-a8f2-79be544540cf" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:19:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:19:11 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:19:11 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:19:11 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:19:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:19:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:19:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:19:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:19:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:19:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:19:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:19:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:19:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:19:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:19:15 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:19:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:19:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:19:15 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:19:16 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:19:16 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:19:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=24.871768951416016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance fb9c516c-282c-49e3-a8f2-79be544540cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:19:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "fb9c516c-282c-49e3-a8f2-79be544540cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:19:22 user nova-compute[75018]: INFO nova.compute.manager [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Terminating instance
Nov 07 16:19:22 user nova-compute[75018]: DEBUG nova.compute.manager [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-56f0e075-4e90-4933-8fb6-6e7c85f7a04e req-12913458-bd02-429e-96a4-b46d2b94c647 service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Received event network-vif-unplugged-525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-56f0e075-4e90-4933-8fb6-6e7c85f7a04e req-12913458-bd02-429e-96a4-b46d2b94c647 service nova] Acquiring lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-56f0e075-4e90-4933-8fb6-6e7c85f7a04e req-12913458-bd02-429e-96a4-b46d2b94c647 service nova] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-56f0e075-4e90-4933-8fb6-6e7c85f7a04e req-12913458-bd02-429e-96a4-b46d2b94c647 service nova] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-56f0e075-4e90-4933-8fb6-6e7c85f7a04e req-12913458-bd02-429e-96a4-b46d2b94c647 service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] No waiting events found dispatching network-vif-unplugged-525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-56f0e075-4e90-4933-8fb6-6e7c85f7a04e req-12913458-bd02-429e-96a4-b46d2b94c647 service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Received event network-vif-unplugged-525dab78-daa8-439e-8c5f-65edb2fd42d4 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 16:19:22 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:23 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Instance destroyed successfully.
Nov 07 16:19:23 user nova-compute[75018]: DEBUG nova.objects.instance [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'resources' on Instance uuid fb9c516c-282c-49e3-a8f2-79be544540cf {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1209926161',display_name='tempest-AttachVolumeNegativeTest-server-1209926161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1209926161',id=50,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHbPdsEuPT2J/1E1MGPTn8btdPlQ6IPmUmSd0wqvKsPmcoGaAJlC4q3wOZTAV6YgLzz4u7TFYyARsAMCKcF31q7HHoV6hh4NkLXIpzTFSbo1FKSnXGUr2fquTqG5a7rGQ==',key_name='tempest-keypair-638197544',keypairs=<?>,launch_index=0,launched_at=2023-11-07T16:16:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='757bf62aa5914b798354f519fcb931ab',ramdisk_id='',reservation_id='r-9devkbnp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1198936328',owner_user_name='tempest-AttachVolumeNegativeTest-1198936328-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T16:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98eb4211b01e424a9f185ab1db143e7a',uuid=fb9c516c-282c-49e3-a8f2-79be544540cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "address": "fa:16:3e:50:cf:a5", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525dab78-da", "ovs_interfaceid": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converting VIF {"id": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "address": "fa:16:3e:50:cf:a5", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525dab78-da", "ovs_interfaceid": "525dab78-daa8-439e-8c5f-65edb2fd42d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:cf:a5,bridge_name='br-int',has_traffic_filtering=True,id=525dab78-daa8-439e-8c5f-65edb2fd42d4,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525dab78-da') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG os_vif [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:cf:a5,bridge_name='br-int',has_traffic_filtering=True,id=525dab78-daa8-439e-8c5f-65edb2fd42d4,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525dab78-da') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap525dab78-da, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1d63e95-6846-4e32-9c0f-e122161d1c82) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:19:23 user nova-compute[75018]: INFO os_vif [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:cf:a5,bridge_name='br-int',has_traffic_filtering=True,id=525dab78-daa8-439e-8c5f-65edb2fd42d4,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525dab78-da')
Nov 07 16:19:23 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Deleting instance files /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf_del
Nov 07 16:19:23 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Deletion of /opt/stack/data/nova/instances/fb9c516c-282c-49e3-a8f2-79be544540cf_del complete
Nov 07 16:19:23 user nova-compute[75018]: INFO nova.compute.manager [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 07 16:19:23 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:19:23 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Took 0.67 seconds to deallocate network for instance.
Nov 07 16:19:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG nova.compute.manager [req-12dd9620-f10f-43f2-8f8d-ec31da6cb140 req-39fa30cc-fb6f-4fb8-9523-3fe4e1758413 service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Received event network-vif-deleted-525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:19:23 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:19:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:19:24 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Deleted allocations for instance fb9c516c-282c-49e3-a8f2-79be544540cf
Nov 07 16:19:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-ba482a4b-3691-43f6-9a16-8451b1450c0d tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.832s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:19:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-7785db79-c90d-4431-b851-8606ee67a550 req-969c45a0-390e-4802-b019-d4c76bf6e046 service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Received event network-vif-plugged-525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:19:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7785db79-c90d-4431-b851-8606ee67a550 req-969c45a0-390e-4802-b019-d4c76bf6e046 service nova] Acquiring lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:19:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7785db79-c90d-4431-b851-8606ee67a550 req-969c45a0-390e-4802-b019-d4c76bf6e046 service nova] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:19:24 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-7785db79-c90d-4431-b851-8606ee67a550 req-969c45a0-390e-4802-b019-d4c76bf6e046 service nova] Lock "fb9c516c-282c-49e3-a8f2-79be544540cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:19:24 user nova-compute[75018]: DEBUG nova.compute.manager [req-7785db79-c90d-4431-b851-8606ee67a550 req-969c45a0-390e-4802-b019-d4c76bf6e046 service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] No waiting events found dispatching network-vif-plugged-525dab78-daa8-439e-8c5f-65edb2fd42d4 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:19:24 user nova-compute[75018]: WARNING nova.compute.manager [req-7785db79-c90d-4431-b851-8606ee67a550 req-969c45a0-390e-4802-b019-d4c76bf6e046 service nova] [instance: fb9c516c-282c-49e3-a8f2-79be544540cf] Received unexpected event network-vif-plugged-525dab78-daa8-439e-8c5f-65edb2fd42d4 for instance with vm_state deleted and task_state None.
Nov 07 16:19:26 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:19:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:19:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:19:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:20:05 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:20:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:20:07 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:20:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:10 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:20:11 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:20:11 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:20:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:20:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:20:11 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 16:20:12 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:20:12 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:20:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:20:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Starting instance... {{(pid=75018) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75018) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 16:20:16 user nova-compute[75018]: INFO nova.compute.claims [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Claim successful on node user
Nov 07 16:20:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Start building networks asynchronously for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.171s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Allocating IP information in the background. {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 16:20:16 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] allocate_for_instance() {{(pid=75018) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG nova.policy [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98eb4211b01e424a9f185ab1db143e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757bf62aa5914b798354f519fcb931ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75018) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 16:20:17 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 16:20:17 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:20:17 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:20:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=9121MB free_disk=24.890804290771484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Start building block device mappings for instance. {{(pid=75018) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance d714969d-b6da-43b1-8d71-ffcd2e1791f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Start spawning the instance on the hypervisor. {{(pid=75018) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Creating instance directory {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 16:20:17 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Creating image(s)
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "/opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "/opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "/opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.179s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "52a35dfab40930b0700886ab54f4da47f590460e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.170s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk 1073741824 {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e,backing_fmt=raw /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk 1073741824" returned: 0 in 0.047s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "52a35dfab40930b0700886ab54f4da47f590460e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a35dfab40930b0700886ab54f4da47f590460e --force-share --output=json" returned: 0 in 0.180s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk. size=1073741824 {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:20:17 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Successfully created port: b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.disk.api [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Cannot resize image /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk to a smaller size. {{(pid=75018) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Created local disks {{(pid=75018) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Ensure instance console log exists: /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/console.log {{(pid=75018) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Successfully updated port: b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquired lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Building network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-20dfc882-9ae5-458c-b7ce-21e2add9bf56 req-89f1c15f-0419-48f2-ba3a-45be436ceb98 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Received event network-changed-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.compute.manager [req-20dfc882-9ae5-458c-b7ce-21e2add9bf56 req-89f1c15f-0419-48f2-ba3a-45be436ceb98 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Refreshing instance network info cache due to event network-changed-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-20dfc882-9ae5-458c-b7ce-21e2add9bf56 req-89f1c15f-0419-48f2-ba3a-45be436ceb98 service nova] Acquiring lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Instance cache missing network info. {{(pid=75018) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.network.neutron [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Updating instance_info_cache with network_info: [{"id": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "address": "fa:16:3e:b4:d5:8f", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ac05b5-1d", "ovs_interfaceid": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Releasing lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Instance network_info: |[{"id": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "address": "fa:16:3e:b4:d5:8f", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ac05b5-1d", "ovs_interfaceid": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75018) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-20dfc882-9ae5-458c-b7ce-21e2add9bf56 req-89f1c15f-0419-48f2-ba3a-45be436ceb98 service nova] Acquired lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.network.neutron [req-20dfc882-9ae5-458c-b7ce-21e2add9bf56 req-89f1c15f-0419-48f2-ba3a-45be436ceb98 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Refreshing network info cache for port b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Start _get_guest_xml network_info=[{"id": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "address": "fa:16:3e:b4:d5:8f", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ac05b5-1d", "ovs_interfaceid": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '667dc137-8627-496e-9a1f-9f5738befeda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 16:20:18 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:20:18 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CPU controller missing on host. {{(pid=75018) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.host [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CPU controller found on host. {{(pid=75018) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75018) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T15:16:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T15:16:42Z,direct_url=<?>,disk_format='qcow2',id=667dc137-8627-496e-9a1f-9f5738befeda,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9ad2a7b49899449c8127f8306add3c2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T15:16:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Flavor limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Image limits 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Flavor pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Image pref 0:0:0 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75018) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Got 1 possible topologies {{(pid=75018) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.hardware [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75018) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:20:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1795565331',display_name='tempest-AttachVolumeNegativeTest-server-1795565331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1795565331',id=51,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPdX4iZ9ugd0Nk+WxOCu/jmIEnmLm3KOwNRdQRLErBDQ2oeoT9bmeL1jUz9x8wMsxZ+chRcl2kuChVN9TJPH3isR0wiyBl/CihxDlDNrFLbqUJD3wqMKgAMr3p03uSzBQ==',key_name='tempest-keypair-1799135353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757bf62aa5914b798354f519fcb931ab',ramdisk_id='',reservation_id='r-20raz3wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1198936328',owner_user_name='tempest-AttachVolumeNegativeTest-1198936328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T16:20:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98eb4211b01e424a9f185ab1db143e7a',uuid=d714969d-b6da-43b1-8d71-ffcd2e1791f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "address": "fa:16:3e:b4:d5:8f", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ac05b5-1d", "ovs_interfaceid": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75018) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converting VIF {"id": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "address": "fa:16:3e:b4:d5:8f", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ac05b5-1d", "ovs_interfaceid": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d5:8f,bridge_name='br-int',has_traffic_filtering=True,id=b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ac05b5-1d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.objects.instance [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'pci_devices' on Instance uuid d714969d-b6da-43b1-8d71-ffcd2e1791f3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] End _get_guest_xml xml=<domain type="kvm">
Nov 07 16:20:18 user nova-compute[75018]:   <uuid>d714969d-b6da-43b1-8d71-ffcd2e1791f3</uuid>
Nov 07 16:20:18 user nova-compute[75018]:   <name>instance-00000033</name>
Nov 07 16:20:18 user nova-compute[75018]:   <memory>524288</memory>
Nov 07 16:20:18 user nova-compute[75018]:   <vcpu>1</vcpu>
Nov 07 16:20:18 user nova-compute[75018]:   <metadata>
Nov 07 16:20:18 user nova-compute[75018]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 16:20:18 user nova-compute[75018]:       <nova:package version="0.0.0"/>
Nov 07 16:20:18 user nova-compute[75018]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1795565331</nova:name>
Nov 07 16:20:18 user nova-compute[75018]:       <nova:creationTime>2023-11-07 16:20:18</nova:creationTime>
Nov 07 16:20:18 user nova-compute[75018]:       <nova:flavor name="m1.tiny">
Nov 07 16:20:18 user nova-compute[75018]:         <nova:memory>512</nova:memory>
Nov 07 16:20:18 user nova-compute[75018]:         <nova:disk>1</nova:disk>
Nov 07 16:20:18 user nova-compute[75018]:         <nova:swap>0</nova:swap>
Nov 07 16:20:18 user nova-compute[75018]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 16:20:18 user nova-compute[75018]:         <nova:vcpus>1</nova:vcpus>
Nov 07 16:20:18 user nova-compute[75018]:       </nova:flavor>
Nov 07 16:20:18 user nova-compute[75018]:       <nova:owner>
Nov 07 16:20:18 user nova-compute[75018]:         <nova:user uuid="98eb4211b01e424a9f185ab1db143e7a">tempest-AttachVolumeNegativeTest-1198936328-project-member</nova:user>
Nov 07 16:20:18 user nova-compute[75018]:         <nova:project uuid="757bf62aa5914b798354f519fcb931ab">tempest-AttachVolumeNegativeTest-1198936328</nova:project>
Nov 07 16:20:18 user nova-compute[75018]:       </nova:owner>
Nov 07 16:20:18 user nova-compute[75018]:       <nova:root type="image" uuid="667dc137-8627-496e-9a1f-9f5738befeda"/>
Nov 07 16:20:18 user nova-compute[75018]:       <nova:ports>
Nov 07 16:20:18 user nova-compute[75018]:         <nova:port uuid="b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722">
Nov 07 16:20:18 user nova-compute[75018]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 16:20:18 user nova-compute[75018]:         </nova:port>
Nov 07 16:20:18 user nova-compute[75018]:       </nova:ports>
Nov 07 16:20:18 user nova-compute[75018]:     </nova:instance>
Nov 07 16:20:18 user nova-compute[75018]:   </metadata>
Nov 07 16:20:18 user nova-compute[75018]:   <sysinfo type="smbios">
Nov 07 16:20:18 user nova-compute[75018]:     <system>
Nov 07 16:20:18 user nova-compute[75018]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 16:20:18 user nova-compute[75018]:       <entry name="product">OpenStack Nova</entry>
Nov 07 16:20:18 user nova-compute[75018]:       <entry name="version">0.0.0</entry>
Nov 07 16:20:18 user nova-compute[75018]:       <entry name="serial">d714969d-b6da-43b1-8d71-ffcd2e1791f3</entry>
Nov 07 16:20:18 user nova-compute[75018]:       <entry name="uuid">d714969d-b6da-43b1-8d71-ffcd2e1791f3</entry>
Nov 07 16:20:18 user nova-compute[75018]:       <entry name="family">Virtual Machine</entry>
Nov 07 16:20:18 user nova-compute[75018]:     </system>
Nov 07 16:20:18 user nova-compute[75018]:   </sysinfo>
Nov 07 16:20:18 user nova-compute[75018]:   <os>
Nov 07 16:20:18 user nova-compute[75018]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 16:20:18 user nova-compute[75018]:     <boot dev="hd"/>
Nov 07 16:20:18 user nova-compute[75018]:     <smbios mode="sysinfo"/>
Nov 07 16:20:18 user nova-compute[75018]:   </os>
Nov 07 16:20:18 user nova-compute[75018]:   <features>
Nov 07 16:20:18 user nova-compute[75018]:     <acpi/>
Nov 07 16:20:18 user nova-compute[75018]:     <apic/>
Nov 07 16:20:18 user nova-compute[75018]:     <vmcoreinfo/>
Nov 07 16:20:18 user nova-compute[75018]:   </features>
Nov 07 16:20:18 user nova-compute[75018]:   <clock offset="utc">
Nov 07 16:20:18 user nova-compute[75018]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 16:20:18 user nova-compute[75018]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 16:20:18 user nova-compute[75018]:     <timer name="hpet" present="no"/>
Nov 07 16:20:18 user nova-compute[75018]:   </clock>
Nov 07 16:20:18 user nova-compute[75018]:   <cpu mode="custom" match="exact">
Nov 07 16:20:18 user nova-compute[75018]:     <model>Nehalem</model>
Nov 07 16:20:18 user nova-compute[75018]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 16:20:18 user nova-compute[75018]:   </cpu>
Nov 07 16:20:18 user nova-compute[75018]:   <devices>
Nov 07 16:20:18 user nova-compute[75018]:     <disk type="file" device="disk">
Nov 07 16:20:18 user nova-compute[75018]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 16:20:18 user nova-compute[75018]:       <source file="/opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk"/>
Nov 07 16:20:18 user nova-compute[75018]:       <target dev="vda" bus="virtio"/>
Nov 07 16:20:18 user nova-compute[75018]:     </disk>
Nov 07 16:20:18 user nova-compute[75018]:     <interface type="ethernet">
Nov 07 16:20:18 user nova-compute[75018]:       <mac address="fa:16:3e:b4:d5:8f"/>
Nov 07 16:20:18 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 16:20:18 user nova-compute[75018]:       <mtu size="1442"/>
Nov 07 16:20:18 user nova-compute[75018]:       <target dev="tapb4ac05b5-1d"/>
Nov 07 16:20:18 user nova-compute[75018]:     </interface>
Nov 07 16:20:18 user nova-compute[75018]:     <serial type="pty">
Nov 07 16:20:18 user nova-compute[75018]:       <log file="/opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/console.log" append="off"/>
Nov 07 16:20:18 user nova-compute[75018]:     </serial>
Nov 07 16:20:18 user nova-compute[75018]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 16:20:18 user nova-compute[75018]:     <video>
Nov 07 16:20:18 user nova-compute[75018]:       <model type="virtio"/>
Nov 07 16:20:18 user nova-compute[75018]:     </video>
Nov 07 16:20:18 user nova-compute[75018]:     <rng model="virtio">
Nov 07 16:20:18 user nova-compute[75018]:       <backend model="random">/dev/urandom</backend>
Nov 07 16:20:18 user nova-compute[75018]:     </rng>
Nov 07 16:20:18 user nova-compute[75018]:     <controller type="usb" index="0" model="none"/>
Nov 07 16:20:18 user nova-compute[75018]:     <memballoon model="virtio">
Nov 07 16:20:18 user nova-compute[75018]:       <stats period="10"/>
Nov 07 16:20:18 user nova-compute[75018]:     </memballoon>
Nov 07 16:20:18 user nova-compute[75018]:   </devices>
Nov 07 16:20:18 user nova-compute[75018]: </domain>
Nov 07 16:20:18 user nova-compute[75018]:  {{(pid=75018) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:20:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1795565331',display_name='tempest-AttachVolumeNegativeTest-server-1795565331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1795565331',id=51,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPdX4iZ9ugd0Nk+WxOCu/jmIEnmLm3KOwNRdQRLErBDQ2oeoT9bmeL1jUz9x8wMsxZ+chRcl2kuChVN9TJPH3isR0wiyBl/CihxDlDNrFLbqUJD3wqMKgAMr3p03uSzBQ==',key_name='tempest-keypair-1799135353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757bf62aa5914b798354f519fcb931ab',ramdisk_id='',reservation_id='r-20raz3wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1198936328',owner_user_name='tempest-AttachVolumeNegativeTest-1198936328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T16:20:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98eb4211b01e424a9f185ab1db143e7a',uuid=d714969d-b6da-43b1-8d71-ffcd2e1791f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "address": "fa:16:3e:b4:d5:8f", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ac05b5-1d", "ovs_interfaceid": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converting VIF {"id": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "address": "fa:16:3e:b4:d5:8f", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ac05b5-1d", "ovs_interfaceid": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d5:8f,bridge_name='br-int',has_traffic_filtering=True,id=b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ac05b5-1d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG os_vif [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d5:8f,bridge_name='br-int',has_traffic_filtering=True,id=b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ac05b5-1d') {{(pid=75018) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbccf066-c7ad-52d4-8b28-b333b61bf667', '_type': 'linux-noop'}}, row=False) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4ac05b5-1d, may_exist=True, interface_attrs={}) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4ac05b5-1d, col_values=(('qos', UUID('7179a861-2b54-4f10-9091-157d60f0288f')),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4ac05b5-1d, col_values=(('external_ids', {'iface-id': 'b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:d5:8f', 'vm-uuid': 'd714969d-b6da-43b1-8d71-ffcd2e1791f3'}),), if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:20:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:18 user nova-compute[75018]: INFO os_vif [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d5:8f,bridge_name='br-int',has_traffic_filtering=True,id=b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ac05b5-1d')
Nov 07 16:20:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 16:20:19 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No VIF found with MAC fa:16:3e:b4:d5:8f, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 16:20:19 user nova-compute[75018]: DEBUG nova.network.neutron [req-20dfc882-9ae5-458c-b7ce-21e2add9bf56 req-89f1c15f-0419-48f2-ba3a-45be436ceb98 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Updated VIF entry in instance network info cache for port b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 16:20:19 user nova-compute[75018]: DEBUG nova.network.neutron [req-20dfc882-9ae5-458c-b7ce-21e2add9bf56 req-89f1c15f-0419-48f2-ba3a-45be436ceb98 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Updating instance_info_cache with network_info: [{"id": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "address": "fa:16:3e:b4:d5:8f", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ac05b5-1d", "ovs_interfaceid": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:20:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-20dfc882-9ae5-458c-b7ce-21e2add9bf56 req-89f1c15f-0419-48f2-ba3a-45be436ceb98 service nova] Releasing lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:20:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-037f6982-9048-421f-bef3-9e6d7db9ae00 req-a248ad40-ebd8-42bc-aac7-b7b62da22c4e service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Received event network-vif-plugged-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:20:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-037f6982-9048-421f-bef3-9e6d7db9ae00 req-a248ad40-ebd8-42bc-aac7-b7b62da22c4e service nova] Acquiring lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:20:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-037f6982-9048-421f-bef3-9e6d7db9ae00 req-a248ad40-ebd8-42bc-aac7-b7b62da22c4e service nova] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:20:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-037f6982-9048-421f-bef3-9e6d7db9ae00 req-a248ad40-ebd8-42bc-aac7-b7b62da22c4e service nova] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:20:20 user nova-compute[75018]: DEBUG nova.compute.manager [req-037f6982-9048-421f-bef3-9e6d7db9ae00 req-a248ad40-ebd8-42bc-aac7-b7b62da22c4e service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] No waiting events found dispatching network-vif-plugged-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:20:20 user nova-compute[75018]: WARNING nova.compute.manager [req-037f6982-9048-421f-bef3-9e6d7db9ae00 req-a248ad40-ebd8-42bc-aac7-b7b62da22c4e service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Received unexpected event network-vif-plugged-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 for instance with vm_state building and task_state spawning.
Nov 07 16:20:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:20 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:21 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:22 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Instance event wait completed in 0 seconds for  {{(pid=75018) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 16:20:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Guest created on hypervisor {{(pid=75018) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 16:20:22 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Instance spawned successfully.
Nov 07 16:20:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 16:20:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Found default for hw_cdrom_bus of ide {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:20:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Found default for hw_disk_bus of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:20:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Found default for hw_input_bus of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:20:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Found default for hw_pointer_model of None {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:20:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Found default for hw_video_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:20:22 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Found default for hw_vif_model of virtio {{(pid=75018) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 16:20:22 user nova-compute[75018]: INFO nova.compute.manager [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 07 16:20:22 user nova-compute[75018]: DEBUG nova.compute.manager [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Checking state {{(pid=75018) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 16:20:22 user nova-compute[75018]: INFO nova.compute.manager [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Took 6.08 seconds to build instance.
Nov 07 16:20:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-b3bbfd40-16ef-45a6-83fe-c9c898c218ee tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.185s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:20:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-3ebb8c61-1a1d-4cc4-8cae-7b6b283348c6 req-9d44b30a-c76b-44e1-91f3-2ccf70fbf4cd service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Received event network-vif-plugged-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:20:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3ebb8c61-1a1d-4cc4-8cae-7b6b283348c6 req-9d44b30a-c76b-44e1-91f3-2ccf70fbf4cd service nova] Acquiring lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:20:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3ebb8c61-1a1d-4cc4-8cae-7b6b283348c6 req-9d44b30a-c76b-44e1-91f3-2ccf70fbf4cd service nova] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:20:22 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3ebb8c61-1a1d-4cc4-8cae-7b6b283348c6 req-9d44b30a-c76b-44e1-91f3-2ccf70fbf4cd service nova] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:20:22 user nova-compute[75018]: DEBUG nova.compute.manager [req-3ebb8c61-1a1d-4cc4-8cae-7b6b283348c6 req-9d44b30a-c76b-44e1-91f3-2ccf70fbf4cd service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] No waiting events found dispatching network-vif-plugged-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:20:22 user nova-compute[75018]: WARNING nova.compute.manager [req-3ebb8c61-1a1d-4cc4-8cae-7b6b283348c6 req-9d44b30a-c76b-44e1-91f3-2ccf70fbf4cd service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Received unexpected event network-vif-plugged-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 for instance with vm_state active and task_state None.
Nov 07 16:20:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:36 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:46 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:51 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:20:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:21:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:21:06 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:21:08 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:21:08 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:21:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:21:10 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:21:12 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:21:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:21:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:21:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:21:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:21:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:21:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:21:13 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:21:13 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid d714969d-b6da-43b1-8d71-ffcd2e1791f3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:21:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:21:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:21:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:21:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:21:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:21:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:21:14 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Updating instance_info_cache with network_info: [{"id": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "address": "fa:16:3e:b4:d5:8f", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ac05b5-1d", "ovs_interfaceid": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:21:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:21:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:21:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:21:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:21:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:21:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:21:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:21:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:21:16 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:21:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:21:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:21:16 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:21:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:21:17 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:21:17 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:21:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8957MB free_disk=24.861446380615234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:21:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:21:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:21:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance d714969d-b6da-43b1-8d71-ffcd2e1791f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:21:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:21:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:21:17 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:21:17 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:21:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:21:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:21:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:21:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:21:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:21:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:21:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:21:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:21:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:21:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:21:31 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:21:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:21:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:21:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:21:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:21:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:21:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:21:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:21:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:21:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:21:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:21:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:21:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:21:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:21:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:21:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:21:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:05 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:22:05 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 16:22:05 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] There are 0 instances to clean {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 16:22:06 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:22:07 user nova-compute[75018]: DEBUG nova.compute.manager [req-3c9af459-9ced-4d08-930a-3d6cb9f662ff req-49d8e9cd-b287-4974-bd41-f6c8a7ea5b76 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Received event network-changed-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:22:07 user nova-compute[75018]: DEBUG nova.compute.manager [req-3c9af459-9ced-4d08-930a-3d6cb9f662ff req-49d8e9cd-b287-4974-bd41-f6c8a7ea5b76 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Refreshing instance network info cache due to event network-changed-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722. {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 16:22:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3c9af459-9ced-4d08-930a-3d6cb9f662ff req-49d8e9cd-b287-4974-bd41-f6c8a7ea5b76 service nova] Acquiring lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:22:07 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3c9af459-9ced-4d08-930a-3d6cb9f662ff req-49d8e9cd-b287-4974-bd41-f6c8a7ea5b76 service nova] Acquired lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:22:07 user nova-compute[75018]: DEBUG nova.network.neutron [req-3c9af459-9ced-4d08-930a-3d6cb9f662ff req-49d8e9cd-b287-4974-bd41-f6c8a7ea5b76 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Refreshing network info cache for port b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 16:22:08 user nova-compute[75018]: DEBUG nova.network.neutron [req-3c9af459-9ced-4d08-930a-3d6cb9f662ff req-49d8e9cd-b287-4974-bd41-f6c8a7ea5b76 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Updated VIF entry in instance network info cache for port b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722. {{(pid=75018) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 16:22:08 user nova-compute[75018]: DEBUG nova.network.neutron [req-3c9af459-9ced-4d08-930a-3d6cb9f662ff req-49d8e9cd-b287-4974-bd41-f6c8a7ea5b76 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Updating instance_info_cache with network_info: [{"id": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "address": "fa:16:3e:b4:d5:8f", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ac05b5-1d", "ovs_interfaceid": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:22:08 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-3c9af459-9ced-4d08-930a-3d6cb9f662ff req-49d8e9cd-b287-4974-bd41-f6c8a7ea5b76 service nova] Releasing lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:22:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:22:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:22:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:22:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:22:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:22:10 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:22:10 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:22:10 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:22:11 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'flavor' on Instance uuid d714969d-b6da-43b1-8d71-ffcd2e1791f3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:22:13 user nova-compute[75018]: INFO nova.compute.manager [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Attaching volume b5c91962-e878-4c39-a7c1-edf5fb80109b to /dev/vdb
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid d714969d-b6da-43b1-8d71-ffcd2e1791f3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG os_brick.utils [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1735f4b8-e619-4809-83dd-d78424f76506]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fb1cd8b9735\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abd368e-4226-4274-b521-4dc2f17acac6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0722eab5-3d61-4a47-8619-61b235e40b90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[64645f5a-54a7-4638-93bf-1a4e0bef097f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Running cmd (subprocess): nvme version {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] 'nvme version' failed. Not Retrying. {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] nvme not present on system {{(pid=75018) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 16:22:13 user nova-compute[75018]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 16:22:13 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca689128-b4a9-4905-831b-65a2bcf49298]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75018) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.lightos [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] LIGHTOS: no hostnqn found. {{(pid=75018) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG os_brick.utils [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fb1cd8b9735', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 16:22:13 user nova-compute[75018]: DEBUG nova.virt.block_device [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Updating existing volume attachment record: 56641954-1fd7-4058-8f2e-f68901c751d2 {{(pid=75018) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 16:22:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:14 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Updating instance_info_cache with network_info: [{"id": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "address": "fa:16:3e:b4:d5:8f", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ac05b5-1d", "ovs_interfaceid": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:22:14 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:22:14 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:22:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:22:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:22:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:22:16 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:22:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:22:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:22:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:22:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:22:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:18 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:22:18 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:22:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=24.860626220703125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance d714969d-b6da-43b1-8d71-ffcd2e1791f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing inventories for resource provider 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating ProviderTree inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing aggregate associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, aggregates: None {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing trait associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:22:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:22:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:20 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:22:20 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75018) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 16:22:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:26 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:29 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Calling os-brick to attach iSCSI Volume {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xmZgkhoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 16:22:34 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:22:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:22:34 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:22:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:22:34 user nova-compute[75018]: INFO os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8db231a-f182-465b-bf05-dcd770021598]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 16:22:34 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d22c70-c3ef-4695-b204-081edb051c16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b] added
Nov 07 16:22:34 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d48d53-a27d-4984-aeca-aa2e70d2954f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc96f58-7745-45cb-9b27-605c934d68d9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xmZgkhoO {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xmZgkhoO" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e703f7-e4c6-4a3e-9ce0-4997f4f64890]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xmZgkhoO'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ca0151-3ab4-4302-8a21-3fe0085be248]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32f5c8e-6752-4207-a2af-a426b83f12c1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 16:22:34 user nova-compute[75018]:  {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:22:34 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 16:22:34 user nova-compute[75018]:  {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 16:22:34 user nova-compute[75018]: WARNING os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 16:22:34 user nova-compute[75018]: 
Nov 07 16:22:34 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d04844b-e9a8-4ac8-9c6c-81db85cad518]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b, portal: 172.16.0.220,3260]
Nov 07 16:22:35 user nova-compute[75018]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b, portal: 172.16.0.220,3260] successful.
Nov 07 16:22:35 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1361b5-65d2-40c3-a77d-e4858d80f3ba]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f41e39a-46f6-4234-bec5-25653a06923f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b (non-flash)
Nov 07 16:22:35 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b (non-flash)
Nov 07 16:22:35 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Connected to 172.16.0.220:3260 {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75018) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75018) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab1eb04-6f6b-45f9-b609-20eb51a0f410]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:35 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 16:22:36 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75018) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 16:22:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xmZgkhoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75018) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 16:22:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:22:36 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23536343730323130', 'path': '/dev/sdb'} {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 16:22:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536343730323130', 'path': '/dev/sdb'} {{(pid=75018) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 16:22:36 user nova-compute[75018]: DEBUG nova.objects.instance [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'flavor' on Instance uuid d714969d-b6da-43b1-8d71-ffcd2e1791f3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:22:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 16:22:36 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 16:22:36 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 16:22:36 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 16:22:36 user nova-compute[75018]:   <serial>b5c91962-e878-4c39-a7c1-edf5fb80109b</serial>
Nov 07 16:22:36 user nova-compute[75018]: </disk>
Nov 07 16:22:36 user nova-compute[75018]:  {{(pid=75018) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 16:22:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No BDM found with device name vda, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 16:22:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75018) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 16:22:36 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] No VIF found with MAC fa:16:3e:b4:d5:8f, not building metadata {{(pid=75018) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 16:22:36 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:22:36 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-3534bae0-a308-4e10-9573-0889c24f69fe tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.003s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:22:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:22:37 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:22:37 user nova-compute[75018]: INFO nova.compute.manager [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Detaching volume b5c91962-e878-4c39-a7c1-edf5fb80109b
Nov 07 16:22:37 user nova-compute[75018]: INFO nova.virt.block_device [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Attempting to driver detach volume b5c91962-e878-4c39-a7c1-edf5fb80109b from mountpoint /dev/vdb
Nov 07 16:22:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Attempting to detach device vdb from instance d714969d-b6da-43b1-8d71-ffcd2e1791f3 from the persistent domain config. {{(pid=75018) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 16:22:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 16:22:37 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 16:22:37 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 16:22:37 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 16:22:37 user nova-compute[75018]:   <serial>b5c91962-e878-4c39-a7c1-edf5fb80109b</serial>
Nov 07 16:22:37 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 16:22:37 user nova-compute[75018]: </disk>
Nov 07 16:22:37 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 16:22:37 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Successfully detached device vdb from instance d714969d-b6da-43b1-8d71-ffcd2e1791f3 from the persistent domain config.
Nov 07 16:22:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d714969d-b6da-43b1-8d71-ffcd2e1791f3 from the live domain config. {{(pid=75018) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 16:22:37 user nova-compute[75018]: DEBUG nova.virt.libvirt.guest [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 16:22:37 user nova-compute[75018]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 16:22:37 user nova-compute[75018]:   <source dev="/dev/sdb"/>
Nov 07 16:22:37 user nova-compute[75018]:   <target dev="vdb" bus="virtio"/>
Nov 07 16:22:37 user nova-compute[75018]:   <serial>b5c91962-e878-4c39-a7c1-edf5fb80109b</serial>
Nov 07 16:22:37 user nova-compute[75018]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 16:22:37 user nova-compute[75018]: </disk>
Nov 07 16:22:37 user nova-compute[75018]:  {{(pid=75018) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 16:22:38 user nova-compute[75018]: DEBUG nova.virt.libvirt.driver [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d714969d-b6da-43b1-8d71-ffcd2e1791f3 {{(pid=75018) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 16:22:39 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:44 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:49 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:58 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d714969d-b6da-43b1-8d71-ffcd2e1791f3 is timed out.
Nov 07 16:22:58 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Successfully detached device vdb from instance d714969d-b6da-43b1-8d71-ffcd2e1791f3 from the live domain config.
Nov 07 16:22:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] calling os-brick to detach iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb0038aa10>, {'target_iqn': 'iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xmZgkhoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 16:22:58 user nova-compute[75018]: WARNING os_brick.initiator.connectors.base [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93821db-3b8e-4025-b889-8da147fc478c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 16:22:58 user nova-compute[75018]: No targets found.
Nov 07 16:22:58 user nova-compute[75018]: iSNS:
Nov 07 16:22:58 user nova-compute[75018]: No targets found.
Nov 07 16:22:58 user nova-compute[75018]: STATIC:
Nov 07 16:22:58 user nova-compute[75018]: Target: iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b
Nov 07 16:22:58 user nova-compute[75018]:         Portal: 172.16.0.220:3260,-1
Nov 07 16:22:58 user nova-compute[75018]:                 Iface Name: default
Nov 07 16:22:58 user nova-compute[75018]: FIRMWARE:
Nov 07 16:22:58 user nova-compute[75018]: No targets found.
Nov 07 16:22:58 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 16:22:58 user nova-compute[75018]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 16:22:58 user nova-compute[75018]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75018) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b', 0)] {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e1c0f7-be3b-418e-a09a-1a6fea74f0f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a31b536-8c3a-4a2b-978e-648822af4f5e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b (non-flash)
Nov 07 16:22:58 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b (non-flash)
Nov 07 16:22:58 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feae035a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b'): ({'sdb'}, set())}) {{(pid=75018) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Removing single pathed devices sdb {{(pid=75018) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdddd23-fe2c-4a75-bcd4-ba2a3734f6f2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed103e8-bea0-469f-a8e4-8c23f4545956]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Flushing IO for device /dev/sdb {{(pid=75018) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecb2ee6-85cc-46f7-b57e-97f60d539f90]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75018) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fc8db5-a428-499b-a2d4-5167daf22f7c]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.linuxscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] SCSI volumes sdb have been removed. {{(pid=75018) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b')] {{(pid=75018) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ce192f-fe8d-4bd9-87e4-e5d651b69fef]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[28285c99-5296-451d-bbc1-344af254d13a]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b, portal: 172.16.0.220,3260]
Nov 07 16:22:58 user nova-compute[75018]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b, portal: 172.16.0.220,3260] successful.
Nov 07 16:22:58 user nova-compute[75018]:  stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c91962-e878-4c39-a7c1-edf5fb80109b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bde5db-04b4-4e92-a183-c519e0f90570]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75018) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.base [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG os_brick.initiator.connectors.iscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] <== disconnect_volume: return (274ms) None {{(pid=75018) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 16:22:58 user nova-compute[75018]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Disconnected iSCSI Volume {{(pid=75018) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 16:22:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:22:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:22:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:22:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:22:59 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:22:59 user nova-compute[75018]: DEBUG nova.objects.instance [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'flavor' on Instance uuid d714969d-b6da-43b1-8d71-ffcd2e1791f3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:22:59 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-52901022-4517-49de-a468-feeefe5f28a6 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.721s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:23:04 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:23:09 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:23:12 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:23:12 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:23:12 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:23:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:23:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:23:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:23:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:23:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:23:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:23:14 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:23:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:23:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:23:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:23:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:23:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 16:23:15 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquired lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 16:23:15 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Forcefully refreshing network info cache for instance {{(pid=75018) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 16:23:15 user nova-compute[75018]: DEBUG nova.objects.instance [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lazy-loading 'info_cache' on Instance uuid d714969d-b6da-43b1-8d71-ffcd2e1791f3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:23:16 user nova-compute[75018]: DEBUG nova.network.neutron [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Updating instance_info_cache with network_info: [{"id": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "address": "fa:16:3e:b4:d5:8f", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ac05b5-1d", "ovs_interfaceid": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:23:16 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Releasing lock "refresh_cache-d714969d-b6da-43b1-8d71-ffcd2e1791f3" {{(pid=75018) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 16:23:16 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Updated the network info_cache for instance {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 16:23:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:23:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:23:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:23:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:23:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:23:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:23:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:23:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:23:17 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk --force-share --output=json {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 16:23:18 user nova-compute[75018]: DEBUG oslo_concurrency.processutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75018) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 16:23:18 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:23:18 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:23:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=24.859786987304688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:23:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:23:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:23:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Instance d714969d-b6da-43b1-8d71-ffcd2e1791f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75018) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 16:23:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:23:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:23:18 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:23:18 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:23:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:23:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:23:19 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:23:24 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:23:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:23:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:23:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:23:27 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:23:27 user nova-compute[75018]: INFO nova.compute.manager [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Terminating instance
Nov 07 16:23:27 user nova-compute[75018]: DEBUG nova.compute.manager [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Start destroying the instance on the hypervisor. {{(pid=75018) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 16:23:27 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-6e191d7d-be23-4691-9084-4eec7c7a9f44 req-bff7e399-e266-4a0c-b960-a27b6a1a0df0 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Received event network-vif-unplugged-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6e191d7d-be23-4691-9084-4eec7c7a9f44 req-bff7e399-e266-4a0c-b960-a27b6a1a0df0 service nova] Acquiring lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6e191d7d-be23-4691-9084-4eec7c7a9f44 req-bff7e399-e266-4a0c-b960-a27b6a1a0df0 service nova] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-6e191d7d-be23-4691-9084-4eec7c7a9f44 req-bff7e399-e266-4a0c-b960-a27b6a1a0df0 service nova] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-6e191d7d-be23-4691-9084-4eec7c7a9f44 req-bff7e399-e266-4a0c-b960-a27b6a1a0df0 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] No waiting events found dispatching network-vif-unplugged-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG nova.compute.manager [req-6e191d7d-be23-4691-9084-4eec7c7a9f44 req-bff7e399-e266-4a0c-b960-a27b6a1a0df0 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Received event network-vif-unplugged-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 for instance with task_state deleting. {{(pid=75018) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [-] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Instance destroyed successfully.
Nov 07 16:23:28 user nova-compute[75018]: DEBUG nova.objects.instance [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lazy-loading 'resources' on Instance uuid d714969d-b6da-43b1-8d71-ffcd2e1791f3 {{(pid=75018) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG nova.virt.libvirt.vif [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T16:20:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1795565331',display_name='tempest-AttachVolumeNegativeTest-server-1795565331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1795565331',id=51,image_ref='667dc137-8627-496e-9a1f-9f5738befeda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPdX4iZ9ugd0Nk+WxOCu/jmIEnmLm3KOwNRdQRLErBDQ2oeoT9bmeL1jUz9x8wMsxZ+chRcl2kuChVN9TJPH3isR0wiyBl/CihxDlDNrFLbqUJD3wqMKgAMr3p03uSzBQ==',key_name='tempest-keypair-1799135353',keypairs=<?>,launch_index=0,launched_at=2023-11-07T16:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='757bf62aa5914b798354f519fcb931ab',ramdisk_id='',reservation_id='r-20raz3wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='667dc137-8627-496e-9a1f-9f5738befeda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1198936328',owner_user_name='tempest-AttachVolumeNegativeTest-1198936328-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T16:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98eb4211b01e424a9f185ab1db143e7a',uuid=d714969d-b6da-43b1-8d71-ffcd2e1791f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "address": "fa:16:3e:b4:d5:8f", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ac05b5-1d", "ovs_interfaceid": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converting VIF {"id": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "address": "fa:16:3e:b4:d5:8f", "network": {"id": "700f7b1a-914f-470a-85e6-dcf315ba9192", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1458043912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757bf62aa5914b798354f519fcb931ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ac05b5-1d", "ovs_interfaceid": "b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG nova.network.os_vif_util [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:d5:8f,bridge_name='br-int',has_traffic_filtering=True,id=b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ac05b5-1d') {{(pid=75018) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG os_vif [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:d5:8f,bridge_name='br-int',has_traffic_filtering=True,id=b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ac05b5-1d') {{(pid=75018) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4ac05b5-1d, bridge=br-int, if_exists=True) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7179a861-2b54-4f10-9091-157d60f0288f) {{(pid=75018) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:23:28 user nova-compute[75018]: INFO os_vif [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:d5:8f,bridge_name='br-int',has_traffic_filtering=True,id=b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722,network=Network(700f7b1a-914f-470a-85e6-dcf315ba9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ac05b5-1d')
Nov 07 16:23:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Deleting instance files /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3_del
Nov 07 16:23:28 user nova-compute[75018]: INFO nova.virt.libvirt.driver [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Deletion of /opt/stack/data/nova/instances/d714969d-b6da-43b1-8d71-ffcd2e1791f3_del complete
Nov 07 16:23:28 user nova-compute[75018]: INFO nova.compute.manager [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 07 16:23:28 user nova-compute[75018]: DEBUG oslo.service.loopingcall [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75018) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG nova.compute.manager [-] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Deallocating network for instance {{(pid=75018) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 16:23:28 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] deallocate_for_instance() {{(pid=75018) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 16:23:29 user nova-compute[75018]: DEBUG nova.network.neutron [-] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Updating instance_info_cache with network_info: [] {{(pid=75018) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 16:23:29 user nova-compute[75018]: INFO nova.compute.manager [-] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Took 0.74 seconds to deallocate network for instance.
Nov 07 16:23:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:23:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:23:29 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:23:29 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:23:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:23:29 user nova-compute[75018]: INFO nova.scheduler.client.report [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Deleted allocations for instance d714969d-b6da-43b1-8d71-ffcd2e1791f3
Nov 07 16:23:29 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-e4f23d50-bfef-4b39-a26f-fb31209a32a7 tempest-AttachVolumeNegativeTest-1198936328 tempest-AttachVolumeNegativeTest-1198936328-project-member] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.950s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:23:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-e416d4d0-bb20-46e7-b494-3212fe5253d6 req-ae14653b-f8f8-44cc-b390-dda813a44327 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Received event network-vif-plugged-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:23:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e416d4d0-bb20-46e7-b494-3212fe5253d6 req-ae14653b-f8f8-44cc-b390-dda813a44327 service nova] Acquiring lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:23:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e416d4d0-bb20-46e7-b494-3212fe5253d6 req-ae14653b-f8f8-44cc-b390-dda813a44327 service nova] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:23:30 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [req-e416d4d0-bb20-46e7-b494-3212fe5253d6 req-ae14653b-f8f8-44cc-b390-dda813a44327 service nova] Lock "d714969d-b6da-43b1-8d71-ffcd2e1791f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:23:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-e416d4d0-bb20-46e7-b494-3212fe5253d6 req-ae14653b-f8f8-44cc-b390-dda813a44327 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] No waiting events found dispatching network-vif-plugged-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 16:23:30 user nova-compute[75018]: WARNING nova.compute.manager [req-e416d4d0-bb20-46e7-b494-3212fe5253d6 req-ae14653b-f8f8-44cc-b390-dda813a44327 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Received unexpected event network-vif-plugged-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 for instance with vm_state deleted and task_state None.
Nov 07 16:23:30 user nova-compute[75018]: DEBUG nova.compute.manager [req-e416d4d0-bb20-46e7-b494-3212fe5253d6 req-ae14653b-f8f8-44cc-b390-dda813a44327 service nova] [instance: d714969d-b6da-43b1-8d71-ffcd2e1791f3] Received event network-vif-deleted-b4ac05b5-1d5b-4d6d-8e41-8f0012c0e722 {{(pid=75018) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 16:23:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:34 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:23:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:23:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:23:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:23:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:23:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:23:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:23:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:23:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:23:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:24:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:24:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:24:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:24:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:24:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:24:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:24:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:24:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:24:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:24:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:24:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:24:13 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:24:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:24:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:24:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:24:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:24:17 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:24:17 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:24:17 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 16:24:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:24:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:24:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:24:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:24:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:24:18 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:24:18 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:24:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=9118MB free_disk=24.88709259033203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:24:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:24:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:24:18 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:24:18 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:24:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:24:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:24:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:24:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:24:20 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:24:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:24:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:24:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:24:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:24:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:24:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:24:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:24:54 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:24:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:25:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:25:07 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:25:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:25:13 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:25:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:25:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:25:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:25:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:25:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:25:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:25:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:25:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:25:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:25:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:25:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:25:17 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:25:17 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:25:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=9122MB free_disk=24.88547134399414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:25:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:25:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:25:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:25:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:25:18 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:25:18 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:25:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:25:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:25:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:25:20 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:25:20 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:25:20 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:25:20 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 16:25:20 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:25:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:25:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:25:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:25:34 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:25:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:25:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:25:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:25:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:25:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:25:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:25:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:25:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:25:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:25:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:26:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:26:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:26:09 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:26:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:26:14 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:26:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:26:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:26:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:26:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:26:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:26:17 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:26:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:26:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:26:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:26:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:26:17 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:26:17 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:26:17 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=9121MB free_disk=24.884075164794922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:26:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:26:17 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:26:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:26:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:26:18 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:26:18 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:26:18 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:26:18 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:26:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:26:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:26:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:26:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:26:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:26:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:26:22 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:26:22 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:26:22 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:26:22 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 16:26:22 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:26:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:26:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:26:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:26:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:26:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:26:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:26:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:26:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:27:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:27:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:27:09 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:27:09 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:27:09 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 16:27:09 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] There are 0 instances to clean {{(pid=75018) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 16:27:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:27:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:27:15 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:27:15 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:27:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:27:18 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:27:18 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:27:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:27:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:27:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:27:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:27:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:27:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:27:19 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:27:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:27:19 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:27:19 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:27:19 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:27:20 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=9128MB free_disk=24.883068084716797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:27:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:27:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:27:20 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:27:20 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:27:20 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing inventories for resource provider 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 16:27:20 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating ProviderTree inventory for provider 54e83767-2936-4d0e-a90c-1dd381218079 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 16:27:20 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Updating inventory in ProviderTree for provider 54e83767-2936-4d0e-a90c-1dd381218079 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 16:27:20 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing aggregate associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, aggregates: None {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 16:27:20 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Refreshing trait associations for resource provider 54e83767-2936-4d0e-a90c-1dd381218079, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING {{(pid=75018) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 16:27:20 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:27:20 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:27:20 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:27:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:27:23 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:27:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:27:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:27:23 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 16:27:23 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:27:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:27:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:27:30 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:27:30 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75018) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 16:27:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:27:35 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:27:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:27:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:27:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:27:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:27:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:27:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:27:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:27:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:27:49 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:27:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:27:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:27:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:27:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:27:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:27:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:27:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:28:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:28:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:28:10 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:28:10 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:28:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:28:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:28:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:28:16 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:28:18 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:28:18 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:28:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:28:19 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:28:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:28:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:28:19 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:28:19 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:28:20 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:28:20 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:28:20 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=9120MB free_disk=24.881305694580078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:28:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:28:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:28:20 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:28:20 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:28:20 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:28:20 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:28:20 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:28:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:28:21 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:28:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:28:24 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:28:24 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:28:24 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:28:24 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 16:28:25 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:28:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:28:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:28:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:28:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:28:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:28:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:28:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:28:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:28:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:28:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:28:52 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:28:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:28:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:28:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:28:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:28:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:28:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:28:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:29:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:29:08 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:29:12 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:29:13 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:29:16 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:29:16 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75018) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 16:29:18 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:29:18 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:29:19 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:29:19 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:29:20 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:29:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:29:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:29:20 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:29:20 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75018) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 16:29:21 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:29:21 user nova-compute[75018]: WARNING nova.virt.libvirt.driver [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 16:29:21 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Hypervisor/Node resource view: name=user free_ram=9128MB free_disk=24.864273071289062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75018) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 16:29:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 16:29:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 16:29:21 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 16:29:21 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75018) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 16:29:21 user nova-compute[75018]: DEBUG nova.compute.provider_tree [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed in ProviderTree for provider: 54e83767-2936-4d0e-a90c-1dd381218079 {{(pid=75018) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 16:29:21 user nova-compute[75018]: DEBUG nova.scheduler.client.report [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Inventory has not changed for provider 54e83767-2936-4d0e-a90c-1dd381218079 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75018) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 16:29:21 user nova-compute[75018]: DEBUG nova.compute.resource_tracker [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Compute_service record updated for user:user {{(pid=75018) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 16:29:21 user nova-compute[75018]: DEBUG oslo_concurrency.lockutils [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.106s {{(pid=75018) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 16:29:23 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:29:23 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:29:25 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:29:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Starting heal instance info cache {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 16:29:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Rebuilding the list of instances to heal {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 16:29:25 user nova-compute[75018]: DEBUG nova.compute.manager [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Didn't find any instances for network info cache update. {{(pid=75018) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 16:29:26 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:29:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:29:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:29:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:29:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:29:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:29:28 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:29:33 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:29:38 user nova-compute[75018]: DEBUG oslo_service.periodic_task [None req-179546b0-f09f-41b7-a3f5-e333fd4f06f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75018) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 16:29:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:29:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:29:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:29:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:29:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:29:38 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:29:41 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:29:43 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:29:48 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 16:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75018) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 16:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75018) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 16:29:53 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:29:58 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 16:30:03 user nova-compute[75018]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75018) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}